{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/shadow-generation-for-composite-image-using","title":"Shadow Generation for Composite Image Using Diffusion model","arxiv_id":"2403.15234","date":"2024-03-22","proceeding":"CVPR 2024 1","authors":["Qingyang Liu","Junqi You","Jianting Wang","Xinhao Tao","Bo Zhang","Li Niu"],"abstract":"In the realm of image composition, generating realistic shadow for the inserted foreground remains a formidable challenge. Previous works have developed image-to-image translation models which are trained on paired training data. However, they are struggling to generate shadows with accurate shapes and intensities, hindered by data scarcity and inherent task complexity. In this paper, we resort to foundation model with rich prior knowledge of natural shadow images. Specifically, we first adapt ControlNet to our task and then propose intensity modulation modules to improve the shadow intensity. Moreover, we extend the small-scale DESOBA dataset to DESOBAv2 using a novel data acquisition pipeline. Experimental results on both DESOBA and DESOBAv2 datasets as well as real composite images demonstrate the superior capability of our model for shadow generation task. The dataset, code, and model are released at https://github.com/bcmi/Object-Shadow-Generation-Dataset-DESOBAv2.","url_abs":"https://arxiv.org/abs/2403.15234v1","url_pdf":"https://arxiv.org/pdf/2403.15234v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"shadow-generation-for-composite-image-using","repo_url":"https://github.com/bcmi/object-shadow-generation-dataset-desobav2","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-to-image-translation","task_name":"Image-to-Image Translation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.15234","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.15234"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/bcmi/Object-Shadow-Generation-Dataset-DESOBAv2","reach":null}],"summary":{"ran":2},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0561e4ebe6ed22c7","entry":"Conv2dWeightModulate","repo":"bcmi/Object-Shadow-Generation-Dataset-DESOBAv2","repo_kind":"official","path":"cldm/GIFT.py","file_url":"https://github.com/bcmi/Object-Shadow-Generation-Dataset-DESOBAv2/blob/HEAD/cldm/GIFT.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0561e4ebe6ed22c7"}},{"code_sha256_prefix":"f98f5a9dbdd50738","entry":"EqualizedWeight","repo":"bcmi/Object-Shadow-Generation-Dataset-DESOBAv2","repo_kind":"official","path":"cldm/GIFT.py","file_url":"https://github.com/bcmi/Object-Shadow-Generation-Dataset-DESOBAv2/blob/HEAD/cldm/GIFT.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f98f5a9dbdd50738"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}