{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/sketchyscene-richly-annotated-scene-sketches","title":"SketchyScene: Richly-Annotated Scene Sketches","arxiv_id":"1808.02473","date":"2018-08-07","proceeding":"ECCV 2018 9","authors":["Changqing Zou","Qian Yu","Ruofei Du","Haoran Mo","Yi-Zhe Song","Tao Xiang","Chengying Gao","Baoquan Chen","Hao Zhang"],"abstract":"We contribute the first large-scale dataset of scene sketches, SketchyScene,\nwith the goal of advancing research on sketch understanding at both the object\nand scene level. The dataset is created through a novel and carefully designed\ncrowdsourcing pipeline, enabling users to efficiently generate large quantities\nof realistic and diverse scene sketches. SketchyScene contains more than 29,000\nscene-level sketches, 7,000+ pairs of scene templates and photos, and 11,000+\nobject sketches. All objects in the scene sketches have ground-truth semantic\nand instance masks. The dataset is also highly scalable and extensible, easily\nallowing augmenting and/or changing scene composition. We demonstrate the\npotential impact of SketchyScene by training new computational models for\nsemantic segmentation of scene sketches and showing how the new dataset enables\nseveral applications including image retrieval, sketch colorization, editing,\nand captioning, etc. The dataset and code can be found at\nhttps://github.com/SketchyScene/SketchyScene.","url_abs":"http://arxiv.org/abs/1808.02473v1","url_pdf":"http://arxiv.org/pdf/1808.02473v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sketchyscene-richly-annotated-scene-sketches","repo_url":"https://github.com/SketchyScene/SketchyScene","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"sketchyscene-richly-annotated-scene-sketches","repo_url":"https://github.com/zzmshinnosuke/sketch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"colorization","task_name":"Colorization"},{"task_slug":"image-retrieval","task_name":"Image Retrieval"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"sketch-colorization","task_name":"Sketch Colorization"}],"methods":[],"datasets_introduced":[{"slug":"sketchyscene","name":"SketchyScene","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1808.02473","atlas_url":"https://app.syntology.ai/?focus=1808.02473","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1808.02473"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SketchyScene/SketchyScene","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zzmshinnosuke/sketch","reach":{"status":"ok"}}],"summary":{"ran":3,"unverified":8},"by_repo_kind":{"official":{"samples":11,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b2aae18de5fa3893","entry":"compute_iou","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/utils.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2aae18de5fa3893"}},{"code_sha256_prefix":"698f3241ee39ad75","entry":"compute_overlaps","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/utils.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"698f3241ee39ad75"}},{"code_sha256_prefix":"d2c9b72e23d9588a","entry":"extract_bboxes","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/utils.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d2c9b72e23d9588a"}},{"code_sha256_prefix":"f998b7fc598210b3","entry":"conv_block","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/model.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f998b7fc598210b3"}},{"code_sha256_prefix":"d5e134d3e4c917dd","entry":"expand_small_segmentation_mask","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/segment_data_generation.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/segment_data_generation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d5e134d3e4c917dd"}},{"code_sha256_prefix":"955c97524949f532","entry":"generate_edgelist","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/edgelist_utils.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/edgelist_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"955c97524949f532"}},{"code_sha256_prefix":"572ccdbc1739d878","entry":"identity_block","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/model.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"572ccdbc1739d878"}},{"code_sha256_prefix":"60c04ed4c9d8ff7a","entry":"label2d_array_nn_scaling","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/edgelist_utils.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/edgelist_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"60c04ed4c9d8ff7a"}},{"code_sha256_prefix":"36da9f33aed27e8d","entry":"myConvertFun","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Semantic_Segmentation/adapted_deeplab_model.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Semantic_Segmentation/adapted_deeplab_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"36da9f33aed27e8d"}},{"code_sha256_prefix":"f0a92532555ad369","entry":"refine_mask_with_edgelist","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/edgelist_utils.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/edgelist_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f0a92532555ad369"}},{"code_sha256_prefix":"5883d43b9e07bf2e","entry":"resnet_graph","repo":"SketchyScene/SketchyScene","repo_kind":"official","path":"Instance_Segmentation/libs/model.py","file_url":"https://github.com/SketchyScene/SketchyScene/blob/HEAD/Instance_Segmentation/libs/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5883d43b9e07bf2e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}