{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2510-08273","title":"One Stone with Two Birds: A Null-Text-Null Frequency-Aware Diffusion Models for Text-Guided Image Inpainting","arxiv_id":"2510.08273","date":"2025-10-09","proceeding":"NeurIPS","authors":["Haipeng Liu","Yang Wang","Meng Wang"],"abstract":"Text-guided image inpainting aims at reconstructing the masked regions as per text prompts, where the longstanding challenges lie in the preservation for unmasked regions, while achieving the semantics consistency between unmasked and inpainted masked regions. Previous arts failed to address both of them, always with either of them to be remedied. Such facts, as we observed, stem from the entanglement of the hybrid (e.g., mid-and-low) frequency bands that encode varied image properties, which exhibit different robustness to text prompts during the denoising process. In this paper, we propose a null-text-null frequency-aware diffusion models, dubbed \\textbf{NTN-Diff}, for text-guided image inpainting, by decomposing the semantics consistency across masked and unmasked regions into the consistencies as per each frequency band, while preserving the unmasked regions, to circumvent two challenges in a row. Based on the diffusion process, we further divide the denoising process into early (high-level noise) and late (low-level noise) stages, where the mid-and-low frequency bands are disentangled during the denoising process. As observed, the stable mid-frequency band is progressively denoised to be semantically aligned during text-guided denoising process, which, meanwhile, serves as the guidance to the null-text denoising process to denoise low-frequency band for the masked regions, followed by a subsequent text-guided denoising process at late stage, to achieve the semantics consistency for mid-and-low frequency bands across masked and unmasked regions, while preserve the unmasked regions. Extensive experiments validate the superiority of NTN-Diff over the state-of-the-art diffusion models to text-guided diffusion models. Our code can be accessed from https://github.com/htyjers/NTN-Diff.","url_abs":"https://arxiv.org/abs/2510.08273","url_pdf":"https://arxiv.org/pdf/2510.08273","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2510.08273","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2510.08273"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/htyjers/NTN-Diff","reach":null}],"summary":{"ran":1,"ran_draft_wrong":4,"ran_fixture":3,"ran_honours":1,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":10,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"37da8e046bd33a07","entry":"DDIM_Sampler","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"37da8e046bd33a07"}},{"code_sha256_prefix":"0830f5f189e4696e","entry":"dct","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0830f5f189e4696e"}},{"code_sha256_prefix":"0d530cb90f3a6799","entry":"dct_2d","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0d530cb90f3a6799"}},{"code_sha256_prefix":"fee7878349a4bec2","entry":"high_pass","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fee7878349a4bec2"}},{"code_sha256_prefix":"6b7692712fdf5c1e","entry":"idct","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6b7692712fdf5c1e"}},{"code_sha256_prefix":"593969f5d90bbf4b","entry":"idct_2d","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"593969f5d90bbf4b"}},{"code_sha256_prefix":"c92c49263d86bc1e","entry":"low_pass","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c92c49263d86bc1e"}},{"code_sha256_prefix":"77e189f36b57fe9c","entry":"make_ddim_sampling_parameters","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"77e189f36b57fe9c"}},{"code_sha256_prefix":"b06da81058d1f9d3","entry":"make_ddim_timesteps","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b06da81058d1f9d3"}},{"code_sha256_prefix":"8038edcb1d4937cb","entry":"Ntn_Sampler","repo":"htyjers/NTN-Diff","repo_kind":"found_in_text","path":"ntn/ntn_sampler.py","file_url":"https://github.com/htyjers/NTN-Diff/blob/HEAD/ntn/ntn_sampler.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8038edcb1d4937cb"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_api"},"syntology_extracted_results":null}