{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ckconv-continuous-kernel-convolution-for","title":"CKConv: Continuous Kernel Convolution For Sequential Data","arxiv_id":"2102.02611","date":"2021-02-04","proceeding":"ICLR 2022 4","authors":["David W. Romero","Anna Kuzina","Erik J. Bekkers","Jakub M. Tomczak","Mark Hoogendoorn"],"abstract":"Conventional neural architectures for sequential data present important limitations. Recurrent networks suffer from exploding and vanishing gradients, small effective memory horizons, and must be trained sequentially. Convolutional networks are unable to handle sequences of unknown size and their memory horizon must be defined a priori. In this work, we show that all these problems can be solved by formulating convolutional kernels in CNNs as continuous functions. The resulting Continuous Kernel Convolution (CKConv) allows us to model arbitrarily long sequences in a parallel manner, within a single operation, and without relying on any form of recurrence. We show that Continuous Kernel Convolutional Networks (CKCNNs) obtain state-of-the-art results in multiple datasets, e.g., permuted MNIST, and, thanks to their continuous nature, are able to handle non-uniformly sampled datasets and irregularly-sampled data natively. CKCNNs match or perform better than neural ODEs designed for these purposes in a faster and simpler manner.","url_abs":"https://arxiv.org/abs/2102.02611v3","url_pdf":"https://arxiv.org/pdf/2102.02611v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ckconv-continuous-kernel-convolution-for","repo_url":"https://github.com/dwromero/ckconv","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":null,"task_name":"Permuted-MNIST"},{"task_slug":"sequential-image-classification","task_name":"Sequential Image Classification"},{"task_slug":"time-series","task_name":"Time Series Analysis"}],"methods":[{"method_slug":"ckconv","method_name":"CKConv"},{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[{"slug":"ckconv","name":"CKConv","full_name":"Continuous Kernel Convolution"}],"results":[{"leaderboard":"/sota/sequential-image-classification-on-sequential-1","task":"Sequential Image Classification","dataset":"Sequential CIFAR-10","model":"CKCNN (1M)","rank_in_archive_order":11,"of":13,"metrics":{"Unpermuted Accuracy":"63.74%"},"uses_additional_data":false},{"leaderboard":"/sota/sequential-image-classification-on-sequential-1","task":"Sequential Image Classification","dataset":"Sequential CIFAR-10","model":"CKCNN (100k)","rank_in_archive_order":12,"of":13,"metrics":{"Unpermuted Accuracy":"62.25%"},"uses_additional_data":false},{"leaderboard":"/sota/sequential-image-classification-on-sequential","task":"Sequential Image Classification","dataset":"Sequential MNIST","model":"CKCNN (1M)","rank_in_archive_order":5,"of":30,"metrics":{"Permuted Accuracy":"98.54%","Unpermuted Accuracy":"99.32%"},"uses_additional_data":false},{"leaderboard":"/sota/sequential-image-classification-on-sequential","task":"Sequential Image Classification","dataset":"Sequential MNIST","model":"CKCNN (100k)","rank_in_archive_order":9,"of":30,"metrics":{"Permuted Accuracy":"98%","Unpermuted Accuracy":"99.31%"},"uses_additional_data":false},{"leaderboard":"/sota/time-series-on-speech-commands","task":"Time Series Analysis","dataset":"Speech Commands","model":"CKCNN (100k)","rank_in_archive_order":5,"of":6,"metrics":{"% Test Accuracy":"95.27"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2102.02611","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}