{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/characterization-of-overlap-in-observational","title":"Characterization of Overlap in Observational Studies","arxiv_id":"1907.04138","date":"2019-07-09","proceeding":null,"authors":["Michael Oberst","Fredrik D. Johansson","Dennis Wei","Tian Gao","Gabriel Brat","David Sontag","Kush R. Varshney"],"abstract":"Overlap between treatment groups is required for non-parametric estimation of causal effects. If a subgroup of subjects always receives the same intervention, we cannot estimate the effect of intervention changes on that subgroup without further assumptions. When overlap does not hold globally, characterizing local regions of overlap can inform the relevance of causal conclusions for new subjects, and can help guide additional data collection. To have impact, these descriptions must be interpretable for downstream users who are not machine learning experts, such as policy makers. We formalize overlap estimation as a problem of finding minimum volume sets subject to coverage constraints and reduce this problem to binary classification with Boolean rule classifiers. We then generalize this method to estimate overlap in off-policy policy evaluation. In several real-world applications, we demonstrate that these rules have comparable accuracy to black-box estimators and provide intuitive and informative explanations that can inform policy making.","url_abs":"https://arxiv.org/abs/1907.04138v3","url_pdf":"https://arxiv.org/pdf/1907.04138v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"characterization-of-overlap-in-observational","repo_url":"https://github.com/clinicalml/overlap-code","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"binary-classification","task_name":"Binary Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1907.04138","atlas_url":"https://app.syntology.ai/?focus=1907.04138","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.04138"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/clinicalml/overlap-code","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":13},"by_repo_kind":{"official":{"samples":13,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f174f1c301e4fbb3","entry":"advCube","repo":"clinicalml/overlap-code","repo_kind":"official","path":"exps/supp-synthetic/data.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/exps/supp-synthetic/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f174f1c301e4fbb3"}},{"code_sha256_prefix":"02dc109ffee84309","entry":"beam_search","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/BCS/beam_search.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/BCS/beam_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"02dc109ffee84309"}},{"code_sha256_prefix":"9a4547b9839a7716","entry":"beam_search_K1","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/BCS/beam_search.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/BCS/beam_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a4547b9839a7716"}},{"code_sha256_prefix":"82cc61fbbdb18a91","entry":"beam_search_no_dup","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/BCS/beam_search.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/BCS/beam_search.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82cc61fbbdb18a91"}},{"code_sha256_prefix":"7e8a806815a34c28","entry":"calc_coverage","repo":"clinicalml/overlap-code","repo_kind":"official","path":"exps/supp-synthetic/synth_utils.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/exps/supp-synthetic/synth_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7e8a806815a34c28"}},{"code_sha256_prefix":"7618a1787899f3ab","entry":"compliance","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/visualization.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/visualization.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7618a1787899f3ab"}},{"code_sha256_prefix":"ff46735c2f67ac5e","entry":"compute_metrics","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/utils.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff46735c2f67ac5e"}},{"code_sha256_prefix":"510723081c5e1bbb","entry":"eval_confusion_matrix","repo":"clinicalml/overlap-code","repo_kind":"official","path":"exps/supp-synthetic/synth_utils.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/exps/supp-synthetic/synth_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"510723081c5e1bbb"}},{"code_sha256_prefix":"9268406fb73cb2bc","entry":"get_feat","repo":"clinicalml/overlap-code","repo_kind":"official","path":"exps/supp-synthetic/data.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/exps/supp-synthetic/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9268406fb73cb2bc"}},{"code_sha256_prefix":"925fab886dce2d30","entry":"print_surgery_rules","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/visualization.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/visualization.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"925fab886dce2d30"}},{"code_sha256_prefix":"5f9c40e76f8e9df3","entry":"print_uti_rules","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/visualization.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/visualization.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f9c40e76f8e9df3"}},{"code_sha256_prefix":"ca5f6d83d0f63806","entry":"sampleUnif","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/utils.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ca5f6d83d0f63806"}},{"code_sha256_prefix":"ceb12f30ebcd5ac8","entry":"sample_reference","repo":"clinicalml/overlap-code","repo_kind":"official","path":"overrule/utils.py","file_url":"https://github.com/clinicalml/overlap-code/blob/HEAD/overrule/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ceb12f30ebcd5ac8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}