{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/linearized-kernel-dictionary-learning","title":"Linearized Kernel Dictionary Learning","arxiv_id":"1509.05634","date":"2015-09-18","proceeding":null,"authors":["Alona Golts","Michael Elad"],"abstract":"In this paper we present a new approach of incorporating kernels into\ndictionary learning. The kernel K-SVD algorithm (KKSVD), which has been\nintroduced recently, shows an improvement in classification performance, with\nrelation to its linear counterpart K-SVD. However, this algorithm requires the\nstorage and handling of a very large kernel matrix, which leads to high\ncomputational cost, while also limiting its use to setups with small number of\ntraining examples. We address these problems by combining two ideas: first we\napproximate the kernel matrix using a cleverly sampled subset of its columns\nusing the Nystr\\\"{o}m method; secondly, as we wish to avoid using this matrix\naltogether, we decompose it by SVD to form new \"virtual samples,\" on which any\nlinear dictionary learning can be employed. Our method, termed \"Linearized\nKernel Dictionary Learning\" (LKDL) can be seamlessly applied as a\npre-processing stage on top of any efficient off-the-shelf dictionary learning\nscheme, effectively \"kernelizing\" it. We demonstrate the effectiveness of our\nmethod on several tasks of both supervised and unsupervised classification and\nshow the efficiency of the proposed scheme, its easy integration and\nperformance boosting properties.","url_abs":"http://arxiv.org/abs/1509.05634v1","url_pdf":"http://arxiv.org/pdf/1509.05634v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"linearized-kernel-dictionary-learning","repo_url":"https://github.com/hilikliming/LKDL-Method","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"dictionary-learning","task_name":"Dictionary Learning"},{"task_slug":"classification","task_name":"General Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}