{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2608-00859","title":"SparseKAN: Compressing Kolmogorov--Arnold Networks Across Basis Functions, Neurons, and Bits","arxiv_id":"2608.00859","date":"2026-08-01","proceeding":null,"authors":["Kazi Ahmed Asif Fuad","Lizhong Chen"],"abstract":"Kolmogorov--Arnold Networks (KANs) replace scalar edge weights with learnable univariate functions parameterized by multiple basis coefficients. This introduces a source of redundancy that conventional neural-network compression does not directly expose. We present \\textbf{SparseKAN}, a unified approach that compresses KANs along three complementary axes: basis functions, neurons/channels, and numerical precision. SparseKAN equips the base branch, nonlinear basis branch, and individual basis terms with hierarchical learnable gates trained under a differentiable active-cost objective. The learned importance structure is subsequently hardened under explicit basis and width budgets, recovered in full or low precision, and physically compacted into smaller dense tensors rather than retained as sparse masks. Experiments on MNIST, CIFAR-10, and CIFAR-100 across spline, polynomial, RBF, wavelet, and convolutional KAN variants show that the structural axes compose predictably in cost. We also find strong basis-dependent differences in term importance: coefficient-based selection outperforms matched low-order truncation by up to 15.25 accuracy points in the evaluated Gram-polynomial settings. Eight-bit quantization is broadly robust, whereas 4-bit convolutional KANs require quantization-aware adaptation. Physical compaction removes up to 73.0\\% of parameters without accuracy loss on MNIST and reduces large-batch CUDA latency to as little as $0.51\\times$ dense execution. On a ZCU104 FPGA, the resulting sparse low-bit models achieve up to $23.63\\times$ lower inference latency, demonstrating that SparseKAN converts functional redundancy into measurable software and hardware efficiency. The SparseKAN implementation is available at https://github.com/OSU-STARLAB/SparseKAN.","url_abs":"https://arxiv.org/abs/2608.00859","url_pdf":"https://arxiv.org/pdf/2608.00859","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2608.00859"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/OSU-STARLAB/SparseKAN","reach":null}],"summary":{"ran":3,"ran_draft_wrong":4,"ran_fixture":2,"ran_honours":1,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":11,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":11,"samples":[{"code_sha256_prefix":"c2b349a818783142","entry":"GumbelSTGate","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c2b349a818783142"}},{"code_sha256_prefix":"e17e8223f90bbb91","entry":"HardConcreteGate","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e17e8223f90bbb91"}},{"code_sha256_prefix":"d735cc6a48b7a865","entry":"SigmoidGate","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d735cc6a48b7a865"}},{"code_sha256_prefix":"5bd46d36e6c49dbe","entry":"_grad_scale","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5bd46d36e6c49dbe"}},{"code_sha256_prefix":"ffa52553c9ac73cb","entry":"_round_ste","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ffa52553c9ac73cb"}},{"code_sha256_prefix":"870eb4673aac6fee","entry":"fake_quantize","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"870eb4673aac6fee"}},{"code_sha256_prefix":"5ae51615c02fda76","entry":"fake_quantize_lsq","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5ae51615c02fda76"}},{"code_sha256_prefix":"860e793f2816fa80","entry":"fake_quantize_soft","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"860e793f2816fa80"}},{"code_sha256_prefix":"a7644ff1b62798d9","entry":"make_gate","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a7644ff1b62798d9"}},{"code_sha256_prefix":"f51b09710564a03a","entry":"prob_to_logit","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f51b09710564a03a"}},{"code_sha256_prefix":"fab318f06aae4456","entry":"SparseKANLayerBase","repo":"OSU-STARLAB/SparseKAN","repo_kind":"found_in_text","path":"sparsekan/core/layers/base.py","file_url":"https://github.com/OSU-STARLAB/SparseKAN/blob/HEAD/sparsekan/core/layers/base.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fab318f06aae4456"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}