{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/stochastic-kernel-regularisation-improves","title":"Stochastic Kernel Regularisation Improves Generalisation in Deep Kernel Machines","arxiv_id":"2410.06171","date":"2024-10-08","proceeding":null,"authors":["Edward Milsom","Ben Anson","Laurence Aitchison"],"abstract":"Recent work developed convolutional deep kernel machines, achieving 92.7% test accuracy on CIFAR-10 using a ResNet-inspired architecture, which is SOTA for kernel methods. However, this still lags behind neural networks, which easily achieve over 94% test accuracy with similar architectures. In this work we introduce several modifications to improve the convolutional deep kernel machine's generalisation, including stochastic kernel regularisation, which adds noise to the learned Gram matrices during training. The resulting model achieves 94.5% test accuracy on CIFAR-10. This finding has important theoretical and practical implications, as it demonstrates that the ability to perform well on complex tasks like image classification is not unique to neural networks. Instead, other approaches including deep kernel methods can achieve excellent performance on such tasks, as long as they have the capacity to learn representations from data.","url_abs":"https://arxiv.org/abs/2410.06171v1","url_pdf":"https://arxiv.org/pdf/2410.06171v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stochastic-kernel-regularisation-improves","repo_url":"https://github.com/edwardmilsom/skr_cdkm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2410.06171","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.06171"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/kuangliu/pytorch-cifar","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/edwardmilsom/skr_cdkm","reach":null}],"summary":{"ran":3,"ran_fixture":1},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"ca65a53b8469b7bd","entry":"GramLayerStableCholesky","repo":"edwardmilsom/skr_cdkm","repo_kind":"official","path":"dkm_most_experiments/dkm/dkm/layer.py","file_url":"https://github.com/edwardmilsom/skr_cdkm/blob/HEAD/dkm_most_experiments/dkm/dkm/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ca65a53b8469b7bd"}},{"code_sha256_prefix":"dcc1b7fe19919599","entry":"LayerCholesky","repo":"edwardmilsom/skr_cdkm","repo_kind":"official","path":"dkm_most_experiments/dkm/dkm/layer.py","file_url":"https://github.com/edwardmilsom/skr_cdkm/blob/HEAD/dkm_most_experiments/dkm/dkm/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dcc1b7fe19919599"}},{"code_sha256_prefix":"bd3c7fee5730d34e","entry":"StructMat","repo":"edwardmilsom/skr_cdkm","repo_kind":"official","path":"dkm_most_experiments/dkm/dkm/layer.py","file_url":"https://github.com/edwardmilsom/skr_cdkm/blob/HEAD/dkm_most_experiments/dkm/dkm/layer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bd3c7fee5730d34e"}},{"code_sha256_prefix":"836e89c54f416f20","entry":"make_meshgrid","repo":"edwardmilsom/skr_cdkm","repo_kind":"official","path":"sine_dataset_condition_curves/dofs_condition_curves_with_taylor.py","file_url":"https://github.com/edwardmilsom/skr_cdkm/blob/HEAD/sine_dataset_condition_curves/dofs_condition_curves_with_taylor.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"836e89c54f416f20"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}