{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-bayesian-spatial-model-to-correct-under","title":"A Bayesian Spatial Model to Correct Under-Reporting in Urban Crowdsourcing","arxiv_id":"2312.11754","date":"2023-12-18","proceeding":null,"authors":["Gabriel Agostini","Emma Pierson","Nikhil Garg"],"abstract":"Decision-makers often observe the occurrence of events through a reporting process. City governments, for example, rely on resident reports to find and then resolve urban infrastructural problems such as fallen street trees, flooded basements, or rat infestations. Without additional assumptions, there is no way to distinguish events that occur but are not reported from events that truly did not occur--a fundamental problem in settings with positive-unlabeled data. Because disparities in reporting rates correlate with resident demographics, addressing incidents only on the basis of reports leads to systematic neglect in neighborhoods that are less likely to report events. We show how to overcome this challenge by leveraging the fact that events are spatially correlated. Our framework uses a Bayesian spatial latent variable model to infer event occurrence probabilities and applies it to storm-induced flooding reports in New York City, further pooling results across multiple storms. We show that a model accounting for under-reporting and spatial correlation predicts future reports more accurately than other models, and further induces a more equitable set of inspections: its allocations better reflect the population and provide equitable service to non-white, less traditionally educated, and lower-income residents. This finding reflects heterogeneous reporting behavior learned by the model: reporting rates are higher in Census tracts with higher populations, proportions of white residents, and proportions of owner-occupied households. Our work lays the groundwork for more equitable proactive government services, even with disparate reporting behavior.","url_abs":"https://arxiv.org/abs/2312.11754v1","url_pdf":"https://arxiv.org/pdf/2312.11754v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-bayesian-spatial-model-to-correct-under","repo_url":"https://github.com/gsagostini/networks_underreporting","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[{"method_slug":null,"method_name":null},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2312.11754","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.11754"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gsagostini/networks_underreporting","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":18,"unverified":3},"by_repo_kind":{"official":{"samples":21,"ran":18,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6d9528d74ceea0aa","entry":"assess_equity_of_inspections","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/evaluate_equity.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/evaluate_equity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d9528d74ceea0aa"}},{"code_sha256_prefix":"1efcec9cbec7afd4","entry":"combine_posteriors","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_pooling.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_pooling.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1efcec9cbec7afd4"}},{"code_sha256_prefix":"d0536ebc53dfe889","entry":"evaluate_improvement","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/evaluate_utils.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/evaluate_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d0536ebc53dfe889"}},{"code_sha256_prefix":"9cbfc3a586a854a2","entry":"fit_normal_pdf_to_samples","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_pooling.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_pooling.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9cbfc3a586a854a2"}},{"code_sha256_prefix":"f903f90d1a598f1f","entry":"generate_graph_grid","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/process_graph.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/process_graph.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f903f90d1a598f1f"}},{"code_sha256_prefix":"fd973d9b1fd5f1e6","entry":"generate_plots_dist_per_graph","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/process_prior.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/process_prior.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fd973d9b1fd5f1e6"}},{"code_sha256_prefix":"96192a04d0fe7849","entry":"get_combined_posterior_from_samples","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_pooling.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_pooling.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"96192a04d0fe7849"}},{"code_sha256_prefix":"ae45c2afda2669db","entry":"get_inspection_count","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/evaluate_equity.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/evaluate_equity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae45c2afda2669db"}},{"code_sha256_prefix":"44571b731a908087","entry":"get_inspection_status","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/evaluate_equity.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/evaluate_equity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"44571b731a908087"}},{"code_sha256_prefix":"8a4cdf17e1d72379","entry":"get_means_and_keys","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/process_prior.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/process_prior.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8a4cdf17e1d72379"}},{"code_sha256_prefix":"a14c496a2abc7088","entry":"get_trivial_probability","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_baselines.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_baselines.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a14c496a2abc7088"}},{"code_sha256_prefix":"c1faeb1d6c219ebb","entry":"initialize_AN","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_MCMC.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_MCMC.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c1faeb1d6c219ebb"}},{"code_sha256_prefix":"94269ba8fe1e8928","entry":"initialize_MCMC","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_MCMC.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_MCMC.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"94269ba8fe1e8928"}},{"code_sha256_prefix":"b8a73b0bb355b4a9","entry":"process_complaints","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/process_complaints.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/process_complaints.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b8a73b0bb355b4a9"}},{"code_sha256_prefix":"1e9d355db10b8dd0","entry":"sample_SVE","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_SVEA.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_SVEA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e9d355db10b8dd0"}},{"code_sha256_prefix":"71be365363b42841","entry":"sample_from_ising","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_SVEA.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_SVEA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"71be365363b42841"}},{"code_sha256_prefix":"02490ec7f099eb85","entry":"sample_ising_Gibbs","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_SVEA.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_SVEA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02490ec7f099eb85"}},{"code_sha256_prefix":"693fed40e010185e","entry":"show_samples","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/evaluate_visualization.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/evaluate_visualization.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"693fed40e010185e"}},{"code_sha256_prefix":"2196c5ac030bd5c6","entry":"evaluate_performance","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/evaluate_utils.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/evaluate_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2196c5ac030bd5c6"}},{"code_sha256_prefix":"05dd8459251c2af8","entry":"get_GP_probability","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/model_baselines.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/model_baselines.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05dd8459251c2af8"}},{"code_sha256_prefix":"c6067f15bc76c0b7","entry":"plot_heatmap","repo":"gsagostini/networks_underreporting","repo_kind":"official","path":"d03_src/process_prior.py","file_url":"https://github.com/gsagostini/networks_underreporting/blob/HEAD/d03_src/process_prior.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c6067f15bc76c0b7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}