{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/co-attention-network-with-label-embedding-for","title":"Co-attention network with label embedding for text classification","arxiv_id":null,"date":"2021-11-04","proceeding":"Neurocomputing 2021 11","authors":["Minqian Liu","Lizhao Liu","Junyi Cao","Qing Du"],"abstract":"Most existing methods for text classification focus on extracting a highly discriminative text representation, which, however, is typically computationally inefficient. To alleviate this issue, label embedding frameworks are proposed to adopt the label-to-text attention that directly uses label information to construct the text representation for more efficient text classification. Although these label embedding methods have achieved promising results, there is still much space for exploring how to se the label information more effectively. In this paper, we seek to exploit the label information by further constructing the text-attended label representation with text-to-label attention. To this end, we propose a Coattention Network with Label Embedding (CNLE) that jointly encodes the text and labels into their mutually attended representations. In this way, the model is able to attend to the relevant parts of both. Experiments show that our approach achieves competitive results compared with previous state-ofthe-art methods on 7 multi-class classification benchmarks and 2 multi-label classification benchmarks.","url_abs":"https://mqianliu.github.io/files/CNLE_Neurocomputing22.pdf","url_pdf":"https://mqianliu.github.io/files/CNLE_Neurocomputing22.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"co-attention-network-with-label-embedding-for","repo_url":"https://github.com/lizhaoliu-Lec/CNLE","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"multi-label-classification-2","task_name":"MUlTI-LABEL-ClASSIFICATION"},{"task_slug":"multi-label-text-classification-1","task_name":"Multi Label Text Classification"},{"task_slug":"multi-label-classification","task_name":"Multi-Label Classification"},{"task_slug":"multi-label-text-classification","task_name":"Multi-Label Text Classification"},{"task_slug":"multi-class-classification","task_name":"Multi-class Classification"},{"task_slug":"text-classification","task_name":"Text Classification"},{"task_slug":"text-classification-1","task_name":"text-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/multi-label-text-classification-on-aapd","task":"Multi-Label Text Classification","dataset":"AAPD","model":"CNLE","rank_in_archive_order":5,"of":5,"metrics":{"Micro F1":"71.7"},"uses_additional_data":false},{"leaderboard":"/sota/multi-label-text-classification-on-reuters-1","task":"Multi-Label Text Classification","dataset":"Reuters-21578","model":"CNLE","rank_in_archive_order":5,"of":7,"metrics":{"Micro-F1":"89.9"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}