{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2606-09601","title":"Assessing Sample Quality in Conditional Generation under Compositional Shift","arxiv_id":"2606.09601","date":"2026-06-08","proceeding":null,"authors":["Berker Demirel","Valentino Maiorca","Marco Fumero","Theofanis Karaletsos","Francesco Locatello"],"abstract":"Conditional generators provide a natural tool for controllable generation, including settings where the desired condition is a new composition of observed attributes or experimental factors. In many applications, especially in scientific domains, such models are attractive to explore conditions for which real samples are rare, expensive, or not yet observed. However, this creates a circularity for evaluation: standard conditional quality metrics require a reference target distribution, but in the extrapolative regime that distribution is unavailable by definition. We address this problem with a post-hoc, per-sample trust score for assessing conditional samples using only the training distribution. The score combines two estimable quantities: global realism, measuring compatibility with the real data manifold, and attribute-wise faithfulness, measuring whether a sample is closer to the requested attributes than to plausible alternatives. We show that the score can recover meaningful comparisons across extrapolated generations, under a mild coverage condition on the observed attributes. These comparisons enable effective filtering, ranking, and abstention of generations and can be used directly on off-the-shelf pretrained models. In biological imaging, selected samples preserve real morphological structure better and improve downstream predictive performance, while similar gains are observed on controlled vision benchmarks. Finally, we show how the score can be applied during generation, enabling abstention before full decoding. Code is available at https://github.com/berkerdemirel/faithful-cond-gen.","url_abs":"https://arxiv.org/abs/2606.09601","url_pdf":"https://arxiv.org/pdf/2606.09601","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2606.09601","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2606.09601"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/berkerdemirel/faithful-cond-gen","reach":null}],"summary":{"ran_draft_wrong":4,"ran_fixture":1,"ran_violates":1},"by_repo_kind":{"found_in_text":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"6115f00ef74eae30","entry":"compute_factorized_faithfulness_margin_z","repo":"berkerdemirel/faithful-cond-gen","repo_kind":"found_in_text","path":"src/faithful_cond_gen/eval/trust_eval/scoring_core.py","file_url":"https://github.com/berkerdemirel/faithful-cond-gen/blob/HEAD/src/faithful_cond_gen/eval/trust_eval/scoring_core.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6115f00ef74eae30"}},{"code_sha256_prefix":"a93a0f1a8cdab64a","entry":"compute_global_realism_z","repo":"berkerdemirel/faithful-cond-gen","repo_kind":"found_in_text","path":"src/faithful_cond_gen/eval/trust_eval/scoring_core.py","file_url":"https://github.com/berkerdemirel/faithful-cond-gen/blob/HEAD/src/faithful_cond_gen/eval/trust_eval/scoring_core.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a93a0f1a8cdab64a"}},{"code_sha256_prefix":"b030003e86385127","entry":"compute_mahalanobis","repo":"berkerdemirel/faithful-cond-gen","repo_kind":"found_in_text","path":"src/faithful_cond_gen/eval/trust_eval/scoring_core.py","file_url":"https://github.com/berkerdemirel/faithful-cond-gen/blob/HEAD/src/faithful_cond_gen/eval/trust_eval/scoring_core.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b030003e86385127"}},{"code_sha256_prefix":"d668caea3552cf9c","entry":"normalize_features","repo":"berkerdemirel/faithful-cond-gen","repo_kind":"found_in_text","path":"src/faithful_cond_gen/eval/trust_eval/scoring_core.py","file_url":"https://github.com/berkerdemirel/faithful-cond-gen/blob/HEAD/src/faithful_cond_gen/eval/trust_eval/scoring_core.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d668caea3552cf9c"}},{"code_sha256_prefix":"51b3b7af21c245e1","entry":"score_trust_from_components","repo":"berkerdemirel/faithful-cond-gen","repo_kind":"found_in_text","path":"src/faithful_cond_gen/eval/trust_eval/scoring_core.py","file_url":"https://github.com/berkerdemirel/faithful-cond-gen/blob/HEAD/src/faithful_cond_gen/eval/trust_eval/scoring_core.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"51b3b7af21c245e1"}},{"code_sha256_prefix":"c14583048e718908","entry":"zscore","repo":"berkerdemirel/faithful-cond-gen","repo_kind":"found_in_text","path":"src/faithful_cond_gen/eval/trust_eval/scoring_core.py","file_url":"https://github.com/berkerdemirel/faithful-cond-gen/blob/HEAD/src/faithful_cond_gen/eval/trust_eval/scoring_core.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c14583048e718908"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}