{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-05635","title":"From Uniform to Learned Knots: A Study of Spline-Based Numerical Encodings for Tabular Deep Learning","arxiv_id":"2604.05635","date":"2026-04-07","proceeding":null,"authors":["Manish Kumar","Anton Frederik Thielmann","Christoph Weisser","Benjamin Säfken"],"abstract":"Numerical preprocessing remains a critical component of tabular deep learning, as the representation of continuous features can strongly affect downstream performance. We systematically study spline-based numerical encodings, including B-splines, M-splines, and integrated splines (I-splines), under uniform, quantile-based, target-aware, and learnable-knot placement. For the learnable variants, we adopt a differentiable knot parameterization that enables stable end-to-end optimization of knot locations jointly with the backbone. We evaluate these encodings on a diverse collection of public regression and classification datasets using MLP, ResNet, and FT-Transformer backbones, and compare them against common numerical preprocessing baselines. Our results show that the effectiveness of numerical encoding depends strongly on the task, encoding size, and backbone. For classification, piecewise-linear encoding (PLE) is the most robust choice overall, while spline-based encodings remain competitive. For regression, no single encoding dominates, with performance depending on the spline family and knot-placement strategy, and larger gains generally observed for MLP and ResNet than for FT-Transformer. Learnable-knot variants can be optimized stably but may substantially increase training cost. Overall, numerical encodings should therefore be assessed jointly in terms of predictive performance and computational overhead. The implementation is publicly available at https://github.com/mkumar73/tdl-numerical-encodings/.","url_abs":"https://arxiv.org/abs/2604.05635","url_pdf":"https://arxiv.org/pdf/2604.05635","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.05635","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.05635"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mkumar73/tdl-numerical-encodings","reach":null}],"summary":{"unverified":7},"by_repo_kind":{"found_in_text":{"samples":7,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f97d757528026f5a","entry":"consolidate_results","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/run_simulated_baseline.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/run_simulated_baseline.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f97d757528026f5a"}},{"code_sha256_prefix":"80608bb92e582beb","entry":"consolidate_results","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/run_simulated_resolution_sweep.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/run_simulated_resolution_sweep.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80608bb92e582beb"}},{"code_sha256_prefix":"5026148715c7e17b","entry":"get_classification_datasets","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/config.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5026148715c7e17b"}},{"code_sha256_prefix":"c89d42680cb09fad","entry":"get_regression_datasets","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/config.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c89d42680cb09fad"}},{"code_sha256_prefix":"16a3f13287bc232e","entry":"get_relative_path","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/logger.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/logger.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"16a3f13287bc232e"}},{"code_sha256_prefix":"ff904316cd31061d","entry":"get_standard_config","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/config.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff904316cd31061d"}},{"code_sha256_prefix":"5aa67120fbea577e","entry":"load_yaml_config","repo":"mkumar73/tdl-numerical-encodings","repo_kind":"found_in_text","path":"src/config_loader.py","file_url":"https://github.com/mkumar73/tdl-numerical-encodings/blob/HEAD/src/config_loader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5aa67120fbea577e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}