{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2605-27254","title":"LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Models","arxiv_id":"2605.27254","date":"2026-05-26","proceeding":null,"authors":["Oroel Ipas","Guillermo Gomez-Trenado","Rocío Romero-Zaliz","Isaac Triguero"],"abstract":"Selecting which instances to label is a key challenge in low-label tabular learning. For recent Tabular Foundation Models such as TabPFN, context selection directly determines predictive performance. Supervised oracle experiments show that carefully chosen labeled context sets can strongly outperform random selection under the same labeling budget. However, the cold-start setting, where instances must be selected before any labels are available, has received little attention in the TFM literature. This problem is fundamentally geometric. In vision and language, foundation models induce embedding spaces where simple geometric selection methods are effective. In contrast, tabular instance selection has so far been performed predominantly in the original tabular space, which lacks a natural metric; heterogeneous types, mixed scales, and nonlinear interactions make raw-space distances unreliable for context construction, and original-space selection falls below random on the majority of datasets as the budget grows. We propose LUCoS (Latent Unsupervised Context Selection), which replaces raw-feature geometry with the latent geometry induced by embeddings from an unsupervised Prior-Fitted Network (PFN) and selects representative medoids as context. Evaluated on 67 OpenML-CC18 datasets across six low-label budgets, LUCoS ranks first under mean AUC, ACC, and F1, with conclusions stable across metrics and dataset-level robustness checks. A gain decomposition reveals a simple mechanism: at the smallest budgets, the main benefit comes from enforcing coverage; as the budget increases, the decisive factor becomes the representation space in which coverage is measured. LUCoS mitigates failures of original feature space selection, showing that reliable unsupervised context selection depends less on selector sophistication than on defining representativeness in a meaningful representation geometry.","url_abs":"https://arxiv.org/abs/2605.27254","url_pdf":"https://arxiv.org/pdf/2605.27254","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2605.27254","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2605.27254"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/ari-dasci/S-LUCoS","reach":null}],"summary":{"ran":3,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ea227f6c92a4cb9f","entry":"exp_id_with_fold","repo":"ari-dasci/S-LUCoS","repo_kind":"found_in_text","path":"src/lucos/unsupervised_context_selection/run_experiment_context_selection.py","file_url":"https://github.com/ari-dasci/S-LUCoS/blob/HEAD/src/lucos/unsupervised_context_selection/run_experiment_context_selection.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea227f6c92a4cb9f"}},{"code_sha256_prefix":"221b2d116fdf1032","entry":"get_obj_from_str","repo":"ari-dasci/S-LUCoS","repo_kind":"found_in_text","path":"src/lucos/utils/config_utils.py","file_url":"https://github.com/ari-dasci/S-LUCoS/blob/HEAD/src/lucos/utils/config_utils.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"221b2d116fdf1032"}},{"code_sha256_prefix":"de3fd68172347b4c","entry":"get_sizes_we_want_to_reduce_to_in_dataset","repo":"ari-dasci/S-LUCoS","repo_kind":"found_in_text","path":"src/lucos/SSMA/run_ssma_selection.py","file_url":"https://github.com/ari-dasci/S-LUCoS/blob/HEAD/src/lucos/SSMA/run_ssma_selection.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de3fd68172347b4c"}},{"code_sha256_prefix":"1ddb4fbff4fbca5f","entry":"parse_folds_arg","repo":"ari-dasci/S-LUCoS","repo_kind":"found_in_text","path":"src/lucos/utils/config_utils.py","file_url":"https://github.com/ari-dasci/S-LUCoS/blob/HEAD/src/lucos/utils/config_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1ddb4fbff4fbca5f"}},{"code_sha256_prefix":"3367e3fc312191d2","entry":"get_pca_and_tsne_embeddings","repo":"ari-dasci/S-LUCoS","repo_kind":"found_in_text","path":"src/lucos/SSMA/ssma_plots.py","file_url":"https://github.com/ari-dasci/S-LUCoS/blob/HEAD/src/lucos/SSMA/ssma_plots.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3367e3fc312191d2"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}