{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/identifying-causal-effect-inference-failure","title":"Identifying Causal-Effect Inference Failure with Uncertainty-Aware Models","arxiv_id":"2007.00163","date":"2020-07-01","proceeding":"NeurIPS 2020 12","authors":["Andrew Jesson","Sören Mindermann","Uri Shalit","Yarin Gal"],"abstract":"Recommending the best course of action for an individual is a major application of individual-level causal effect estimation. This application is often needed in safety-critical domains such as healthcare, where estimating and communicating uncertainty to decision-makers is crucial. We introduce a practical approach for integrating uncertainty estimation into a class of state-of-the-art neural network methods used for individual-level causal estimates. We show that our methods enable us to deal gracefully with situations of \"no-overlap\", common in high-dimensional data, where standard applications of causal effect approaches fail. Further, our methods allow us to handle covariate shift, where test distribution differs to train distribution, common when systems are deployed in practice. We show that when such a covariate shift occurs, correctly modeling uncertainty can keep us from giving overconfident and potentially harmful recommendations. We demonstrate our methodology with a range of state-of-the-art models. Under both covariate shift and lack of overlap, our uncertainty-equipped methods can alert decisions makers when predictions are not to be trusted while outperforming their uncertainty-oblivious counterparts.","url_abs":"https://arxiv.org/abs/2007.00163v2","url_pdf":"https://arxiv.org/pdf/2007.00163v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"identifying-causal-effect-inference-failure","repo_url":"https://github.com/OATML/ucate","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2007.00163","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.00163"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/OATML/ucate","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8a450eb7c9c79fe7","entry":"branch_bias_l2","repo":"OATML/ucate","repo_kind":"official","path":"ucate/library/layers.py","file_url":"https://github.com/OATML/ucate/blob/HEAD/ucate/library/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8a450eb7c9c79fe7"}},{"code_sha256_prefix":"fd0b693f8a80043b","entry":"branch_l2","repo":"OATML/ucate","repo_kind":"official","path":"ucate/library/layers.py","file_url":"https://github.com/OATML/ucate/blob/HEAD/ucate/library/layers.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fd0b693f8a80043b"}},{"code_sha256_prefix":"235deecbc29e97e9","entry":"get_density_estimator","repo":"OATML/ucate","repo_kind":"official","path":"ucate/library/scratch.py","file_url":"https://github.com/OATML/ucate/blob/HEAD/ucate/library/scratch.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"235deecbc29e97e9"}},{"code_sha256_prefix":"6226c7421bb125b3","entry":"mmd","repo":"OATML/ucate","repo_kind":"official","path":"ucate/library/models/tarnet.py","file_url":"https://github.com/OATML/ucate/blob/HEAD/ucate/library/models/tarnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6226c7421bb125b3"}},{"code_sha256_prefix":"67a5d0b74aeaad68","entry":"propensity_loss","repo":"OATML/ucate","repo_kind":"official","path":"ucate/library/models/tarnet.py","file_url":"https://github.com/OATML/ucate/blob/HEAD/ucate/library/models/tarnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"67a5d0b74aeaad68"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}