{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-06484","title":"Estimate Level Adjustment For Inference With Proxies Under Random Distribution Shifts","arxiv_id":"2605.06484","date":"2026-05-07","proceeding":null,"authors":["Steven Wilkins-Reeves","Alexandra N. M. Darmon","Deeksha Sinha"],"abstract":"In many scientific domains, including experimentation, researchers rely on measurements of proxy outcomes to achieve faster and more frequent reads, especially when the primary outcome of interest is challenging to measure directly. While proxies offer a more readily accessible observation for inference, the ultimate goal is to draw statistical inferences about the primary outcome parameter and proxy data are typically imperfect in some ways. To correct for these imperfections, current statistical inference methods often depend on strict identifying assumptions (such as surrogacy, covariate/label shift, or missingness assumptions). These assumptions can be difficult to validate and may be violated by various additional sources of distribution shift, potentially leading to biased parameter estimates and miscalibrated uncertainty quantification. We introduce an estimate-level framework, inspired by domain adaptation techniques, to empirically calibrate proxy-based inference. This framework models the proxy-primary metric discrepancy as a random effect at the parameter level, estimating its distribution from aggregated historical observations across past domains (e.g., experiments, time periods, or distinct segments). This method avoids the requirement for retaining individual-level response data. Additionally, this adjustment can be layered on top of existing proxy-correction methods (such as prediction-powered inference or importance weighting) to account for additional biases not addressed by those corrections. To manage uncertainty when the number of historical domains is limited, we provide both a method-of-moments estimator and a domain bootstrap procedure. We further validate this approach using publicly available datasets and real-world experiments.","url_abs":"https://arxiv.org/abs/2605.06484","url_pdf":"https://arxiv.org/pdf/2605.06484","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.06484","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.06484"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/facebookresearch/estimate-level-adjustment","reach":null}],"summary":{"ran_honours":3,"ran":1,"ran_fixture":1,"unverified":8},"by_repo_kind":{"found_in_text":{"samples":13,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5030f53ef074c950","entry":"alpha_to_z","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"5030f53ef074c950"}},{"code_sha256_prefix":"12cb1e5e75e3951d","entry":"conf_to_z","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"12cb1e5e75e3951d"}},{"code_sha256_prefix":"a9c1a5d3063afce2","entry":"fit_latent_normal","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"a9c1a5d3063afce2"}},{"code_sha256_prefix":"a30e49e03f54918b","entry":"get_ci","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"a30e49e03f54918b"}},{"code_sha256_prefix":"e09a30d552ae235c","entry":"negative_log_likelihood","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"e09a30d552ae235c"}},{"code_sha256_prefix":"47de9d1f1c180ec1","entry":"AdjustedCovShiftPPIEstimator","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"47de9d1f1c180ec1"}},{"code_sha256_prefix":"ed23a6a4d94a3f60","entry":"AdjustedEstimate","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"ed23a6a4d94a3f60"}},{"code_sha256_prefix":"7926d3206a2e430f","entry":"BootstrapEstimate","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"7926d3206a2e430f"}},{"code_sha256_prefix":"493c90af733ce0c6","entry":"CovShiftPPIEstimator","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"493c90af733ce0c6"}},{"code_sha256_prefix":"27696f0174161dfd","entry":"DomainBootstrapEstimate","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"27696f0174161dfd"}},{"code_sha256_prefix":"4fb7e2399b4d8a3c","entry":"DomainEstimateStats","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"4fb7e2399b4d8a3c"}},{"code_sha256_prefix":"dccc4bd1492e50bb","entry":"Estimate","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"dccc4bd1492e50bb"}},{"code_sha256_prefix":"438536fdbafd498b","entry":"FitResult","repo":"facebookresearch/estimate-level-adjustment","repo_kind":"found_in_text","path":"estimate_level_adjustment/adjusted_ppi_estimator.py","file_url":"https://github.com/facebookresearch/estimate-level-adjustment/blob/HEAD/estimate_level_adjustment/adjusted_ppi_estimator.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"438536fdbafd498b"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}