{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-10477","title":"Urban Socio-Semantic Segmentation with Vision-Language Reasoning","arxiv_id":"2601.10477","date":"2026-01-15","proceeding":null,"authors":["Yu Wang","Yi Wang","Rui Dai","Yujie Wang","Kaikui Liu","Xiangxiang Chu","Yansheng Li"],"abstract":"As hubs of human activity, urban surfaces consist of a wealth of semantic entities. Segmenting these various entities from satellite imagery is crucial for a range of downstream applications. Current advanced segmentation models can reliably segment entities defined by physical attributes (e.g., buildings, water bodies) but still struggle with socially defined categories (e.g., schools, parks). In this work, we achieve socio-semantic segmentation by vision-language model reasoning. To facilitate this, we introduce the Urban Socio-Semantic Segmentation dataset named SocioSeg, a new resource comprising satellite imagery, digital maps, and pixel-level labels of social semantic entities organized in a hierarchical structure. Additionally, we propose a novel vision-language reasoning framework called SocioReasoner that simulates the human process of identifying and annotating social semantic entities via cross-modal recognition and multi-stage reasoning. We employ reinforcement learning to optimize this non-differentiable process and elicit the reasoning capabilities of the vision-language model. Experiments demonstrate our approach's gains over state-of-the-art models and strong zero-shot generalization. The dataset and code are open-sourced under the Apache License 2.0 at https://github.com/AMAP-ML/SocioReasoner.","url_abs":"https://arxiv.org/abs/2601.10477","url_pdf":"https://arxiv.org/pdf/2601.10477","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2601.10477","atlas_url":"https://app.syntology.ai/?focus=2601.10477","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.10477"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/AMAP-ML/SocioReasoner","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":1,"unverified":6},"by_repo_kind":{"found_in_text":{"samples":7,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a063873313ec0a07","entry":"filter_forward_args","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"roll/models/func_providers.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/roll/models/func_providers.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a063873313ec0a07"}},{"code_sha256_prefix":"a940969bae605850","entry":"distributed_concat","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"mcore_adapter/src/mcore_adapter/utils.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/mcore_adapter/src/mcore_adapter/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a940969bae605850"}},{"code_sha256_prefix":"9b40061bc20d82e3","entry":"distributed_reduce","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"mcore_adapter/src/mcore_adapter/utils.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/mcore_adapter/src/mcore_adapter/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9b40061bc20d82e3"}},{"code_sha256_prefix":"92a8337ca2e3095a","entry":"get_checkpoint_tracker_filename","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"mcore_adapter/src/mcore_adapter/checkpointing.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/mcore_adapter/src/mcore_adapter/checkpointing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"92a8337ca2e3095a"}},{"code_sha256_prefix":"0ca242314116dc9c","entry":"get_logger","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"mcore_adapter/src/mcore_adapter/utils.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/mcore_adapter/src/mcore_adapter/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0ca242314116dc9c"}},{"code_sha256_prefix":"414bb5321e52ac1b","entry":"no_set_device_hook_post_init","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"roll/models/trl_patches.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/roll/models/trl_patches.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"414bb5321e52ac1b"}},{"code_sha256_prefix":"ba3f7804e93d016e","entry":"read_metadata","repo":"AMAP-ML/SocioReasoner","repo_kind":"found_in_text","path":"mcore_adapter/src/mcore_adapter/checkpointing.py","file_url":"https://github.com/AMAP-ML/SocioReasoner/blob/HEAD/mcore_adapter/src/mcore_adapter/checkpointing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ba3f7804e93d016e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}