{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/improving-k-means-clustering-performance-with","title":"Improving k-Means Clustering Performance with Disentangled Internal Representations","arxiv_id":"2006.04535","date":"2020-06-05","proceeding":null,"authors":["Abien Fred Agarap","Arnulfo P. Azcarraga"],"abstract":"Deep clustering algorithms combine representation learning and clustering by jointly optimizing a clustering loss and a non-clustering loss. In such methods, a deep neural network is used for representation learning together with a clustering network. Instead of following this framework to improve clustering performance, we propose a simpler approach of optimizing the entanglement of the learned latent code representation of an autoencoder. We define entanglement as how close pairs of points from the same class or structure are, relative to pairs of points from different classes or structures. To measure the entanglement of data points, we use the soft nearest neighbor loss, and expand it by introducing an annealing temperature factor. Using our proposed approach, the test clustering accuracy was 96.2% on the MNIST dataset, 85.6% on the Fashion-MNIST dataset, and 79.2% on the EMNIST Balanced dataset, outperforming our baseline models.","url_abs":"https://arxiv.org/abs/2006.04535v1","url_pdf":"https://arxiv.org/pdf/2006.04535v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"improving-k-means-clustering-performance-with","repo_url":"https://gitlab.com/afagarap/pt-snnl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"deep-clustering","task_name":"Deep Clustering"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-clustering","task_name":"Image Clustering"},{"task_slug":"representation-learning","task_name":"Representation Learning"}],"methods":[{"method_slug":"annealing-snnl","method_name":"Annealing SNNL"}],"datasets_introduced":[],"methods_introduced":[{"slug":"annealing-snnl","name":"Annealing SNNL","full_name":"Soft Nearest Neighbor Loss with Annealing Temperature"}],"results":[{"leaderboard":"/sota/image-classification-on-emnist-balanced","task":"Image Classification","dataset":"EMNIST-Balanced","model":"SNNL-5","rank_in_archive_order":19,"of":20,"metrics":{"Accuracy":"78.5","NMI":"77.6"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-fashion-mnist","task":"Image Classification","dataset":"Fashion-MNIST","model":"SNNL-5","rank_in_archive_order":32,"of":34,"metrics":{"Accuracy":"84.4","NMI":"76.2"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-mnist","task":"Image Classification","dataset":"MNIST","model":"SNNL-5","rank_in_archive_order":79,"of":81,"metrics":{"Accuracy":"95.5"},"uses_additional_data":false},{"leaderboard":"/sota/image-clustering-on-emnist-balanced","task":"Image Clustering","dataset":"EMNIST-Balanced","model":"AE+SNNL","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"0.792","NMI":"0.783"},"uses_additional_data":false},{"leaderboard":"/sota/image-clustering-on-emnist-balanced","task":"Image Clustering","dataset":"EMNIST-Balanced","model":"SNNL-8","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"0.35","NMI":"0.442"},"uses_additional_data":false},{"leaderboard":"/sota/image-clustering-on-fashion-mnist","task":"Image Clustering","dataset":"Fashion-MNIST","model":"SNNL-4","rank_in_archive_order":13,"of":13,"metrics":{"Accuracy":"0.555","NMI":"0.574"},"uses_additional_data":false},{"leaderboard":"/sota/image-clustering-on-mnist","task":"Image Clustering","dataset":"MNIST","model":"SNNL-7","rank_in_archive_order":3,"of":3,"metrics":{"NMI":"0.891"},"uses_additional_data":false},{"leaderboard":"/sota/image-clustering-on-mnist-test","task":"Image Clustering","dataset":"MNIST-test","model":"AE+SNNL","rank_in_archive_order":8,"of":11,"metrics":{"Accuracy":"0.962","NMI":"0.903"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2006.04535","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}