{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-shared-representation-for-photorealistic","title":"A Shared Representation for Photorealistic Driving Simulators","arxiv_id":"2112.05134","date":"2021-12-09","proceeding":null,"authors":["Saeed Saadatnejad","Siyuan Li","Taylor Mordan","Alexandre Alahi"],"abstract":"A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Networks (cGANs), providing high-fidelity images. The main challenge is synthesizing photorealistic images while following given constraints. In this work, we propose to improve the quality of generated images by rethinking the discriminator architecture. The focus is on the class of problems where images are generated given semantic inputs, such as scene segmentation maps or human body poses. We build on successful cGAN models to propose a new semantically-aware discriminator that better guides the generator. We aim to learn a shared latent representation that encodes enough information to jointly do semantic segmentation, content reconstruction, along with a coarse-to-fine grained adversarial reasoning. The achieved improvements are generic and simple enough to be applied to any architecture of conditional image synthesis. We demonstrate the strength of our method on the scene, building, and human synthesis tasks across three different datasets. The code is available at https://github.com/vita-epfl/SemDisc.","url_abs":"https://arxiv.org/abs/2112.05134v1","url_pdf":"https://arxiv.org/pdf/2112.05134v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-shared-representation-for-photorealistic","repo_url":"https://github.com/vita-epfl/semdisc","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"autonomous-vehicles","task_name":"Autonomous Vehicles"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"scene-segmentation","task_name":"Scene Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2112.05134","atlas_url":"https://app.syntology.ai/?focus=2112.05134","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2112.05134"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/vita-epfl/semdisc","reach":null}],"summary":{"ran_draft_wrong":3,"ran_honours":1,"unverified":5},"by_repo_kind":{"official":{"samples":9,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"fac5364e2f53c6db","entry":"conv3x3","repo":"vita-epfl/semdisc","repo_kind":"official","path":"models/networks/resnet.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/models/networks/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"fac5364e2f53c6db"}},{"code_sha256_prefix":"aa4cae054b657ba2","entry":"imread","repo":"vita-epfl/semdisc","repo_kind":"official","path":"fid/pytorch-fid/fid_score.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/fid/pytorch-fid/fid_score.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"aa4cae054b657ba2"}},{"code_sha256_prefix":"4787d8e0f0b166f1","entry":"resnet18","repo":"vita-epfl/semdisc","repo_kind":"official","path":"models/networks/resnet.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/models/networks/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"4787d8e0f0b166f1"}},{"code_sha256_prefix":"a4b31bd3557d4a38","entry":"resnet34","repo":"vita-epfl/semdisc","repo_kind":"official","path":"models/networks/resnet.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/models/networks/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"a4b31bd3557d4a38"}},{"code_sha256_prefix":"0def50a351111624","entry":"calculate_frechet_distance","repo":"vita-epfl/semdisc","repo_kind":"official","path":"fid/pytorch-fid/fid_score.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/fid/pytorch-fid/fid_score.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"0def50a351111624"}},{"code_sha256_prefix":"2222cd506f9b4a12","entry":"get_activations","repo":"vita-epfl/semdisc","repo_kind":"official","path":"fid/pytorch-fid/fid_score.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/fid/pytorch-fid/fid_score.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"2222cd506f9b4a12"}},{"code_sha256_prefix":"73e5ba02454ef86b","entry":"load_img","repo":"vita-epfl/semdisc","repo_kind":"official","path":"utils.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"73e5ba02454ef86b"}},{"code_sha256_prefix":"7b824a35ea6deb12","entry":"postprocess","repo":"vita-epfl/semdisc","repo_kind":"official","path":"utils.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"7b824a35ea6deb12"}},{"code_sha256_prefix":"869616720c4c8c60","entry":"preprocess","repo":"vita-epfl/semdisc","repo_kind":"official","path":"utils.py","file_url":"https://github.com/vita-epfl/semdisc/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"AGPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"869616720c4c8c60"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}