{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/semantic-image-matting","title":"Semantic Image Matting","arxiv_id":"2104.08201","date":"2021-04-16","proceeding":"CVPR 2021 1","authors":["Yanan sun","Chi-Keung Tang","Yu-Wing Tai"],"abstract":"Natural image matting separates the foreground from background in fractional occupancy which can be caused by highly transparent objects, complex foreground (e.g., net or tree), and/or objects containing very fine details (e.g., hairs). Although conventional matting formulation can be applied to all of the above cases, no previous work has attempted to reason the underlying causes of matting due to various foreground semantics. We show how to obtain better alpha mattes by incorporating into our framework semantic classification of matting regions. Specifically, we consider and learn 20 classes of matting patterns, and propose to extend the conventional trimap to semantic trimap. The proposed semantic trimap can be obtained automatically through patch structure analysis within trimap regions. Meanwhile, we learn a multi-class discriminator to regularize the alpha prediction at semantic level, and content-sensitive weights to balance different regularization losses. Experiments on multiple benchmarks show that our method outperforms other methods and has achieved the most competitive state-of-the-art performance. Finally, we contribute a large-scale Semantic Image Matting Dataset with careful consideration of data balancing across different semantic classes.","url_abs":"https://arxiv.org/abs/2104.08201v1","url_pdf":"https://arxiv.org/pdf/2104.08201v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"semantic-image-matting","repo_url":"https://github.com/nowsyn/SIM","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-matting","task_name":"Image Matting"},{"task_slug":"semantic-image-matting","task_name":"Semantic Image Matting"},{"task_slug":"transparent-objects","task_name":"Transparent objects"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-matting-on-composition-1k-1","task":"Image Matting","dataset":"Composition-1K","model":"SIM","rank_in_archive_order":10,"of":13,"metrics":{"Conn":"24.8","Grad":"10.8","MSE":"5.8","SAD":"28.0"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-image-matting-on-semantic-image","task":"Semantic Image Matting","dataset":"Semantic Image Matting Dataset","model":"SIM","rank_in_archive_order":1,"of":4,"metrics":{"Conn":"20.83","Grad":"11.57","MSE(10^3)":"4.7","SAD":"27.87"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2104.08201","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.08201"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nowsyn/SIM","reach":null}],"summary":{"unverified":1},"by_repo_kind":{"official":{"samples":1,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"c46be57a56264f46","entry":"MattingModule","repo":"nowsyn/SIM","repo_kind":"official","path":"networks/model.py","file_url":"https://github.com/nowsyn/SIM/blob/HEAD/networks/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c46be57a56264f46"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}