{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/effective-neural-topic-modeling-with","title":"Effective Neural Topic Modeling with Embedding Clustering Regularization","arxiv_id":"2306.04217","date":"2023-06-07","proceeding":null,"authors":["Xiaobao Wu","Xinshuai Dong","Thong Nguyen","Anh Tuan Luu"],"abstract":"Topic models have been prevalent for decades with various applications. However, existing topic models commonly suffer from the notorious topic collapsing: discovered topics semantically collapse towards each other, leading to highly repetitive topics, insufficient topic discovery, and damaged model interpretability. In this paper, we propose a new neural topic model, Embedding Clustering Regularization Topic Model (ECRTM). Besides the existing reconstruction error, we propose a novel Embedding Clustering Regularization (ECR), which forces each topic embedding to be the center of a separately aggregated word embedding cluster in the semantic space. This enables each produced topic to contain distinct word semantics, which alleviates topic collapsing. Regularized by ECR, our ECRTM generates diverse and coherent topics together with high-quality topic distributions of documents. Extensive experiments on benchmark datasets demonstrate that ECRTM effectively addresses the topic collapsing issue and consistently surpasses state-of-the-art baselines in terms of topic quality, topic distributions of documents, and downstream classification tasks.","url_abs":"https://arxiv.org/abs/2306.04217v1","url_pdf":"https://arxiv.org/pdf/2306.04217v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"effective-neural-topic-modeling-with","repo_url":"https://github.com/bobxwu/ecrtm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"effective-neural-topic-modeling-with","repo_url":"https://github.com/bobxwu/topmost","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"topic-models","task_name":"Topic Models"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2306.04217","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.04217"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bobxwu/topmost","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/bobxwu/ecrtm","reach":{"status":"ok"}}],"summary":{"ran":4},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1},"listed":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"7957a00c1ef36c94","entry":"ECR","repo":"bobxwu/ecrtm","repo_kind":"official","path":"ECRTM/models/ECRTM.py","file_url":"https://github.com/bobxwu/ecrtm/blob/HEAD/ECRTM/models/ECRTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7957a00c1ef36c94"}},{"code_sha256_prefix":"b573ee331a772a9e","entry":"ECR","repo":"bobxwu/topmost","repo_kind":"listed","path":"topmost/models/basic/ECRTM/ECRTM.py","file_url":"https://github.com/bobxwu/topmost/blob/HEAD/topmost/models/basic/ECRTM/ECRTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b573ee331a772a9e"}},{"code_sha256_prefix":"3ecb75966fec2a1f","entry":"ECRTM","repo":"bobxwu/ecrtm","repo_kind":"official","path":"ECRTM/models/ECRTM.py","file_url":"https://github.com/bobxwu/ecrtm/blob/HEAD/ECRTM/models/ECRTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ecb75966fec2a1f"}},{"code_sha256_prefix":"ee25fc5913ae78c9","entry":"ECRTM","repo":"bobxwu/topmost","repo_kind":"listed","path":"topmost/models/basic/ECRTM/ECRTM.py","file_url":"https://github.com/bobxwu/topmost/blob/HEAD/topmost/models/basic/ECRTM/ECRTM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ee25fc5913ae78c9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}