{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2608-11746","title":"Epiplexity Guided Data Selection and Generation for Out-of-Distribution Generalization","arxiv_id":"2608.11746","date":"2026-08-12","proceeding":null,"authors":["Ellen Su","Andres Potapczynski","Shikai Qiu","Edward Hughes","Andrew Gordon Wilson"],"abstract":"Modern systems are increasingly expected to transfer across tasks not specified during training. What data facilitates generalization in these new, unanticipated settings? One hypothesis is that data with more structural information could contain shared circuits and subprograms that could be recycled in a wider array of downstream settings. Epiplexity, a recently proposed measure of the structural information a compute-bounded learner can extract from data, provides a mechanism to reason about this relationship. In this paper, we show how to operationalize epiplexity as an online training signal for data selection and synthetic data generation. For selection, we fit scaling laws to the training loss curves of natural data domains to predict the expected epiplexity gain as a function of training tokens, and use this signal to adaptively determine the sampling weights over domains during training. For synthetic data generation, we define a generator's reward as the change in learner epiplexity over a buffer of previously generated data and use REINFORCE policy gradients to guide the generator toward an epiplexity-maximizing distribution. In both cases, higher epiplexity predicts improved downstream performance on zero-shot and fine-tuning based tasks, supporting the hypothesis that data rich in structural information yield representations that transfer across domains.","url_abs":"https://arxiv.org/abs/2608.11746","url_pdf":"https://arxiv.org/pdf/2608.11746","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2608.11746"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/eysu35/EpiSelect","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/eysu35/EpiGen","reach":null}],"summary":{"ran":1,"ran_draft_wrong":4,"ran_fixture":4,"ran_violates":1,"unverified":6},"by_repo_kind":{"found_in_text":{"samples":15,"ran":9,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"8be0c7e5666488fa","entry":"AdoSelector","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8be0c7e5666488fa"}},{"code_sha256_prefix":"291e3a301fa78f99","entry":"_loss_drop","repo":"eysu35/EpiGen","repo_kind":"found_in_text","path":"datagen/reward.py","file_url":"https://github.com/eysu35/EpiGen/blob/HEAD/datagen/reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"291e3a301fa78f99"}},{"code_sha256_prefix":"caaf85b54c820675","entry":"_mean_loss","repo":"eysu35/EpiGen","repo_kind":"found_in_text","path":"datagen/reward.py","file_url":"https://github.com/eysu35/EpiGen/blob/HEAD/datagen/reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"caaf85b54c820675"}},{"code_sha256_prefix":"dcab7970577723d4","entry":"clip_min_probability","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dcab7970577723d4"}},{"code_sha256_prefix":"306cc94884ceceb1","entry":"compute_epiplexity_reward","repo":"eysu35/EpiGen","repo_kind":"found_in_text","path":"datagen/reward.py","file_url":"https://github.com/eysu35/EpiGen/blob/HEAD/datagen/reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"306cc94884ceceb1"}},{"code_sha256_prefix":"b2591cd2d6a28012","entry":"huber_loss","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"b2591cd2d6a28012"}},{"code_sha256_prefix":"17180e7f72ec1016","entry":"learner_step","repo":"eysu35/EpiGen","repo_kind":"found_in_text","path":"datagen/reward.py","file_url":"https://github.com/eysu35/EpiGen/blob/HEAD/datagen/reward.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"17180e7f72ec1016"}},{"code_sha256_prefix":"ce4f99f57dbd7b4c","entry":"logsumexp","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce4f99f57dbd7b4c"}},{"code_sha256_prefix":"24dca89866b40710","entry":"loss_fn","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24dca89866b40710"}},{"code_sha256_prefix":"e8311143bd921dda","entry":"scaling_law","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e8311143bd921dda"}},{"code_sha256_prefix":"b40456cc4a4a8c5e","entry":"EpiSelect","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b40456cc4a4a8c5e"}},{"code_sha256_prefix":"32709a3f6aa9a8a4","entry":"_log_loss","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"32709a3f6aa9a8a4"}},{"code_sha256_prefix":"68eaf73f648d7adc","entry":"_unpack","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68eaf73f648d7adc"}},{"code_sha256_prefix":"b515e97d3e3151f4","entry":"epiplexity_grads","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b515e97d3e3151f4"}},{"code_sha256_prefix":"66593ea791591f0d","entry":"fit_scaling_law","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66593ea791591f0d"}},{"code_sha256_prefix":"c31892feba4967e2","entry":"readout_params","repo":"eysu35/EpiSelect","repo_kind":"found_in_text","path":"src/data_selectors/episelect.py","file_url":"https://github.com/eysu35/EpiSelect/blob/HEAD/src/data_selectors/episelect.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c31892feba4967e2"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}