Papers › An Unsupervised Domain Adaptation Scheme for Single-Stage Artwork Recognition in Cultural Sites

An Unsupervised Domain Adaptation Scheme for Single-Stage Artwork Recognition in Cultural Sites

4 Aug 2020arXiv:2008.01882archive 2025-07-28

Giovanni Pasqualino, Antonino Furnari, Giovanni Signorello, Giovanni Maria Farinella

Recognizing artworks in a cultural site using images acquired from the user's point of view (First Person Vision) allows to build interesting applications for both the visitors and the site managers. However, current object detection algorithms working in fully supervised settings need to be trained with large quantities of labeled data, whose collection requires a lot of times and high costs in order to achieve good performance. Using synthetic data generated from the 3D model of the cultural site to train the algorithms can reduce these costs. On the other hand, when these models are tested with real images, a significant drop in performance is observed due to the differences between real and synthetic images. In this study we consider the problem of Unsupervised Domain Adaptation for object detection in cultural sites. To address this problem, we created a new dataset containing both synthetic and real images of 16 different artworks. We hence investigated different domain adaptation techniques based on one-stage and two-stage object detector, image-to-image translation and feature alignment. Based on the observation that single-stage detectors are more robust to the domain shift in the considered settings, we proposed a new method which builds on RetinaNet and feature alignment that we called DA-RetinaNet. The proposed approach achieves better results than compared methods on the proposed dataset and on Cityscapes. To support research in this field we release the dataset at the following link https://iplab.dmi.unict.it/EGO-CH-OBJ-UDA/ and the code of the proposed architecture at https://github.com/fpv-iplab/DA-RetinaNet.

PaperPDFCode

Code

fpv-iplab/DA-RetinaNet officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Domain AdaptationImage-to-Image TranslationObject DetectionUnsupervised Domain Adaptationobject-detection

Datasets

Introduced by this paper, per the archive.

UDA-CH

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Domain Adaptation Cityscapes to Foggy Cityscapes DA-RetinaNet mAP@0.5 41.87 #16 of 22 Archive leaderboard report
Unsupervised Domain Adaptation UDA-CH DA-RetinaNet mAP@0.50 58.01 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionConvolutionFPNFocal LossRetinaNet

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections