{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-10187","title":"Decision-Calibrated Conformal Uncertainty for Pacing Decisions in Streaming Advertising","arxiv_id":"2606.10187","date":"2026-06-08","proceeding":null,"authors":["Prashant Shekhar","Caroline Howard"],"abstract":"We develop a decision-calibrated conformal framework for pacing decisions in streaming advertising. Pacing depends on uncertain future inventory, demand pressure, incremental response, and member-experience load. Instead of calibrating a generic forecast residual, the framework measures forecast error by its largest impact on the policies that could actually be deployed. The main theorem shows that the proposed score is the smallest valid uncertainty measure that uniformly protects all deployable pacing policies. Geometrically, it is the support function of the signed policy sensitivity set. Split conformal calibration gives finite-sample coverage for this score. A high-dimensional separation theorem shows that traditional residual calibration can be arbitrarily more conservative by paying for nuisance inventory dimensions, and a robust pacing result combines inventory, response, and experience uncertainty. On public-data-calibrated pacing replays built from Criteo Uplift and KuaiRand datasets, traditional conformal pacing remains unresolved with high residual radii of 7236.7 on Criteo and 4629.4 on KuaiRand. With the proposed decision calibration approach, the uncertainty radii are reduced to 18.4 and 278.6 respectively, with separate margins for value, delivery, budget, and member load. On Criteo, the proposed method certifies a less aggressive pacing policy than the point-forecast baseline, and reduces held-out any-violation rate from 16.7% to 3.3%, with zero budget and member-load violations. On KuaiRand, the choice remains unresolved. In a nutshell, the paper establishes that forecasts, response estimates, and member-experience models should be judged by whether they shrink the uncertainty that the pacing decision uses, as this leads to confident decisions that are not overly conservative.","url_abs":"https://arxiv.org/abs/2606.10187","url_pdf":"https://arxiv.org/pdf/2606.10187","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2606.10187","atlas_url":"https://app.syntology.ai/?focus=2606.10187","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.10187"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/p-shekhar/pacing-decisions-advertising","reach":null}],"summary":{"ran_honours":4,"ran_draft_wrong":5,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":13,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"61366531f3e83e24","entry":"_segment_campaign_profile","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"61366531f3e83e24"}},{"code_sha256_prefix":"c7a490ecd6a9738e","entry":"component_sensitivity_matrices","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c7a490ecd6a9738e"}},{"code_sha256_prefix":"ced7de83db89a6f0","entry":"conformal_quantile","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ced7de83db89a6f0"}},{"code_sha256_prefix":"dd03df7a5059c48c","entry":"decision_scores","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd03df7a5059c48c"}},{"code_sha256_prefix":"d3e1e851a080a450","entry":"evaluate_policy","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3e1e851a080a450"}},{"code_sha256_prefix":"ff908a458ca33ca5","entry":"generic_scores","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff908a458ca33ca5"}},{"code_sha256_prefix":"1b1ae6ec4aeb18e8","entry":"nominal_dual_prices","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b1ae6ec4aeb18e8"}},{"code_sha256_prefix":"2499e795b51358ae","entry":"policy_coefficients","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2499e795b51358ae"}},{"code_sha256_prefix":"a0e03e242ca543c3","entry":"policy_targets","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0e03e242ca543c3"}},{"code_sha256_prefix":"4f0d15e65ff0dada","entry":"Policy","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4f0d15e65ff0dada"}},{"code_sha256_prefix":"f795e4d070f0583e","entry":"PolicyEvaluation","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f795e4d070f0583e"}},{"code_sha256_prefix":"a1e2e4d2a9e6d112","entry":"StreamingCase","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1e2e4d2a9e6d112"}},{"code_sha256_prefix":"3b9ef301c8f9411b","entry":"calibrate_radii","repo":"p-shekhar/pacing-decisions-advertising","repo_kind":"found_in_text","path":"src/pacing.py","file_url":"https://github.com/p-shekhar/pacing-decisions-advertising/blob/HEAD/src/pacing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b9ef301c8f9411b"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,885 of the 9,623 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9623,"papers_checked":6885},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}