{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/map-guided-curriculum-domain-adaptation-and","title":"Map-Guided Curriculum Domain Adaptation and Uncertainty-Aware Evaluation for Semantic Nighttime Image Segmentation","arxiv_id":"2005.14553","date":"2020-05-28","proceeding":null,"authors":["Christos Sakaridis","Dengxin Dai","Luc van Gool"],"abstract":"We address the problem of semantic nighttime image segmentation and improve the state-of-the-art, by adapting daytime models to nighttime without using nighttime annotations. Moreover, we design a new evaluation framework to address the substantial uncertainty of semantics in nighttime images. Our central contributions are: 1) a curriculum framework to gradually adapt semantic segmentation models from day to night through progressively darker times of day, exploiting cross-time-of-day correspondences between daytime images from a reference map and dark images to guide the label inference in the dark domains; 2) a novel uncertainty-aware annotation and evaluation framework and metric for semantic segmentation, including image regions beyond human recognition capability in the evaluation in a principled fashion; 3) the Dark Zurich dataset, comprising 2416 unlabeled nighttime and 2920 unlabeled twilight images with correspondences to their daytime counterparts plus a set of 201 nighttime images with fine pixel-level annotations created with our protocol, which serves as a first benchmark for our novel evaluation. Experiments show that our map-guided curriculum adaptation significantly outperforms state-of-the-art methods on nighttime sets both for standard metrics and our uncertainty-aware metric. Furthermore, our uncertainty-aware evaluation reveals that selective invalidation of predictions can improve results on data with ambiguous content such as our benchmark and profit safety-oriented applications involving invalid inputs.","url_abs":"https://arxiv.org/abs/2005.14553v2","url_pdf":"https://arxiv.org/pdf/2005.14553v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"map-guided-curriculum-domain-adaptation-and","repo_url":"https://github.com/sakaridis/MGCDA","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"domain-adaptation","task_name":"Domain Adaptation"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/domain-adaptation-on-cityscapes-to-acdc","task":"Domain Adaptation","dataset":"Cityscapes to ACDC","model":"MGCDA","rank_in_archive_order":13,"of":16,"metrics":{"mIoU":"48.7"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-dark-zurich","task":"Semantic Segmentation","dataset":"Dark Zurich","model":"MGCDA","rank_in_archive_order":10,"of":14,"metrics":{"mIoU":"42.5"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-nighttime-driving","task":"Semantic Segmentation","dataset":"Nighttime Driving","model":"MGCDA","rank_in_archive_order":5,"of":13,"metrics":{"mIoU":"49.4"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2005.14553","atlas_url":"https://app.syntology.ai/?focus=2005.14553","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}