Papers › Semi-supervised Human Pose Estimation in Art-historical Images

Semi-supervised Human Pose Estimation in Art-historical Images

6 Jul 2022arXiv:2207.02976archive 2025-07-28

Matthias Springstein, Stefanie Schneider, Christian Althaus, Ralph Ewerth

Gesture as language of non-verbal communication has been theoretically established since the 17th century. However, its relevance for the visual arts has been expressed only sporadically. This may be primarily due to the sheer overwhelming amount of data that traditionally had to be processed by hand. With the steady progress of digitization, though, a growing number of historical artifacts have been indexed and made available to the public, creating a need for automatic retrieval of art-historical motifs with similar body constellations or poses. Since the domain of art differs significantly from existing real-world data sets for human pose estimation due to its style variance, this presents new challenges. In this paper, we propose a novel approach to estimate human poses in art-historical images. In contrast to previous work that attempts to bridge the domain gap with pre-trained models or through style transfer, we suggest semi-supervised learning for both object and keypoint detection. Furthermore, we introduce a novel domain-specific art data set that includes both bounding box and keypoint annotations of human figures. Our approach achieves significantly better results than methods that use pre-trained models or style transfer.

PaperPDFCode

Code

tibhannover/iart-semi-pose officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

2D Human Pose EstimationKeypoint DetectionPose EstimationRetrievalSemi-Supervised Human Pose EstimationStyle Transfer

Datasets

Introduced by this paper, per the archive.

PoPArt

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 mAP 52.58 #1 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 mAP@0.5 63.92 #1 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 mAP@0.75 57.35 #1 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on PeopleArt) mAP 29.71 #2 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on PeopleArt) mAP@0.5 36.37 #2 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on PeopleArt) mAP@0.75 32.72 #2 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 0 % style-transferred Material) mAP 25.25 #3 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 0 % style-transferred Material) mAP@0.5 31.73 #3 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 0 % style-transferred Material) mAP@0.75 28.10 #3 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 100 % style-transferred Material) mAP 25.18 #4 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 100 % style-transferred Material) mAP@0.5 31.67 #4 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 100 % style-transferred Material) mAP@0.75 28.13 #4 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 50 % style-transferred Material) mAP 24.13 #5 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 50 % style-transferred Material) mAP@0.5 30.52 #5 of 5 Archive leaderboard report
Semi-Supervised Human Pose Estimation PoPArt HRNet-W32 (trained on COCO 2017 with 50 % style-transferred Material) mAP@0.75 26.65 #5 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections