{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-08913","title":"GEMSS: A Variational Method for Discovering Multiple Sparse Solutions in Classification and Regression Problems","arxiv_id":"2602.08913","date":"2026-02-09","proceeding":null,"authors":["Kateřina Henclová","Václav Šmídl"],"abstract":"In underdetermined regression and classification problems, multiple feature subsets often yield equivalent predictive performance. In applied settings, especially with $n \\ll p$, high dimension or collinearities, it is valuable to provide a domain expert with a menu of statistically plausible explanations, rather than one arbitrary solution. This creates the need for appropriate methods. We present Gaussian Ensemble for Multiple Sparse Solutions (GEMSS), a method that uses a single variational mixture to approximate the corresponding multimodal posterior. Its evidence lower bound contains a built-in repulsion between the mixture's components, enabling the model to simultaneously produce several distinct sparse solutions. We evaluate GEMSS on a novel, reusable benchmark. The ground-truth solution set and its structure are known by construction and set-level recovery metrics are evaluated. GEMSS consistently outperforms dedicated multiplicity methods (Enumeration LASSO, ALFESE), two strong sampling baselines that approximate the same posterior (Randomized-LASSO ensemble, BB-SSL), and naive iterative masking. As solutions' overlap increases, the gap widens and additional ensemble restarts cannot close it. Only ALFESE proves competitive. Further, GEMSS is validated on real-world datasets, producing multiple distinct and highly predictive solutions: the practical goal that existing methods struggle to meet. The open-source Python package 'gemss' is available (github.com/kat-er-ina/gemss) and democratized through a free online application at huggingface.co/spaces/kat-er-ina/gemss.","url_abs":"https://arxiv.org/abs/2602.08913","url_pdf":"https://arxiv.org/pdf/2602.08913","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2602.08913","atlas_url":"https://app.syntology.ai/?focus=2602.08913","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.08913"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/kat-er-ina/gemss","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/kat-er-ina/gemss_testing","reach":null}],"summary":{"unverified":21},"by_repo_kind":{"found_in_text":{"samples":21,"ran":0,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":13,"samples":[{"code_sha256_prefix":"5e372b1774b9c227","entry":"calculate_metrics","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/src/evaluation.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/src/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5e372b1774b9c227"}},{"code_sha256_prefix":"b7ba0e35ec109577","entry":"calculate_structural_metrics","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/src/evaluation.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/src/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b7ba0e35ec109577"}},{"code_sha256_prefix":"e3acd7ac32186cfe","entry":"case2set","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/experiment_assessment/case_analysis.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/experiment_assessment/case_analysis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e3acd7ac32186cfe"}},{"code_sha256_prefix":"611a7bb17d4ce09a","entry":"cluster_supports","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/ensemble_parity.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/ensemble_parity.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"611a7bb17d4ce09a"}},{"code_sha256_prefix":"d81f7dd887ede59c","entry":"cluster_to_m","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/bb_ssl_probe.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/bb_ssl_probe.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d81f7dd887ede59c"}},{"code_sha256_prefix":"d4ad6f14626c11d6","entry":"concatenate_cases","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/experiment_assessment/case_analysis.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/experiment_assessment/case_analysis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d4ad6f14626c11d6"}},{"code_sha256_prefix":"374885459d29217c","entry":"fnum","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/stats_agg.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/stats_agg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"374885459d29217c"}},{"code_sha256_prefix":"54f97ea347da57c8","entry":"generate_multi_solution_data","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/data_handling/generate_artificial_dataset.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/data_handling/generate_artificial_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"54f97ea347da57c8"}},{"code_sha256_prefix":"e1b61e8d1483509f","entry":"generate_overlapping_dataset","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/src/hard_data_factory.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/src/hard_data_factory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e1b61e8d1483509f"}},{"code_sha256_prefix":"f431064ae42a70ec","entry":"get_current_config","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/config/config.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/config/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f431064ae42a70ec"}},{"code_sha256_prefix":"19a01f4f22f9d6f9","entry":"get_df_cases","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/experiment_assessment/case_analysis.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/experiment_assessment/case_analysis.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19a01f4f22f9d6f9"}},{"code_sha256_prefix":"eab9128873931edc","entry":"get_feature_name_mapping","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/data_handling/data_processing.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/data_handling/data_processing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eab9128873931edc"}},{"code_sha256_prefix":"d74e72b488187ee7","entry":"get_params_by_category","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/config/config.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/config/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d74e72b488187ee7"}},{"code_sha256_prefix":"e66085c8d8e9ee07","entry":"get_recommendation_message","repo":"kat-er-ina/gemss","repo_kind":"found_in_text","path":"gemss/diagnostics/recommendation_messages.py","file_url":"https://github.com/kat-er-ina/gemss/blob/HEAD/gemss/diagnostics/recommendation_messages.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e66085c8d8e9ee07"}},{"code_sha256_prefix":"717e32343d81591f","entry":"grid","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/tuned_compare.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/tuned_compare.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"717e32343d81591f"}},{"code_sha256_prefix":"0b1bf82b4f68387b","entry":"load","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/stats_agg.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/stats_agg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0b1bf82b4f68387b"}},{"code_sha256_prefix":"51ef4e782dbd034a","entry":"per_seed_at_best","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/stats_agg.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/stats_agg.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"51ef4e782dbd034a"}},{"code_sha256_prefix":"d0aac9ca6073644b","entry":"perplexity","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/rq5_count.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/rq5_count.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d0aac9ca6073644b"}},{"code_sha256_prefix":"27e46af6b8cf6e9c","entry":"predictive_quality","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/src/evaluation.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/src/evaluation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"27e46af6b8cf6e9c"}},{"code_sha256_prefix":"4452d07a638099f3","entry":"run_bbssl","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/diagnostics/bb_ssl_probe.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/diagnostics/bb_ssl_probe.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4452d07a638099f3"}},{"code_sha256_prefix":"6987276b3c379eef","entry":"support_recovery_check","repo":"kat-er-ina/gemss_testing","repo_kind":"found_in_text","path":"algorithm_comparison/src/hard_data_factory.py","file_url":"https://github.com/kat-er-ina/gemss_testing/blob/HEAD/algorithm_comparison/src/hard_data_factory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6987276b3c379eef"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}