Papers › Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text...

Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification

24 May 2019arXiv:1905.10070archive 2025-07-28

Xin Huang, Boli Chen, Lin Xiao, Liping Jing

Extreme multi-label text classification (XMTC) aims at tagging a document with most relevant labels from an extremely large-scale label set. It is a challenging problem especially for the tail labels because there are only few training documents to build classifier. This paper is motivated to better explore the semantic relationship between each document and extreme labels by taking advantage of both document content and label correlation. Our objective is to establish an explicit label-aware representation for each document with a hybrid attention deep neural network model(LAHA). LAHA consists of three parts. The first part adopts a multi-label self-attention mechanism to detect the contribution of each word to labels. The second part exploits the label structure and document content to determine the semantic connection between words and labels in a same latent space. An adaptive fusion strategy is designed in the third part to obtain the final label-aware document representation so that the essence of previous two parts can be sufficiently integrated. Extensive experiments have been conducted on six benchmark datasets by comparing with the state-of-the-art methods. The results show the superiority of our proposed LAHA method, especially on the tail labels.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

HX-idiot/Hybrid_Attention_XML officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

General ClassificationMulti Label Text ClassificationMulti-Label Text ClassificationText Classificationtext-classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Multi-Label Text Classification AAPD LAHA P@1 84.48 #2 of 5 Archive leaderboard report
Multi-Label Text Classification AAPD LAHA P@3 60.72 #2 of 5 Archive leaderboard report
Multi-Label Text Classification AAPD LAHA P@5 41.19 #2 of 5 Archive leaderboard report
Multi-Label Text Classification AAPD LAHA nDCG@3 80.11 #2 of 5 Archive leaderboard report
Multi-Label Text Classification AAPD LAHA nDCG@5 83.7 #2 of 5 Archive leaderboard report
Multi-Label Text Classification Amazon-12K LAHA P@1 94.87 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Amazon-12K LAHA P@3 79.16 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Amazon-12K LAHA P@5 63.16 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Amazon-12K LAHA nDCG@3 89.13 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Amazon-12K LAHA nDCG@5 87.57 #1 of 1 Archive leaderboard report
Multi-Label Text Classification EUR-Lex LAHA P@1 74.95 #3 of 3 Archive leaderboard report
Multi-Label Text Classification EUR-Lex LAHA P@3 61.48 #3 of 3 Archive leaderboard report
Multi-Label Text Classification EUR-Lex LAHA P@5 50.71 #3 of 3 Archive leaderboard report
Multi-Label Text Classification EUR-Lex LAHA nDCG@3 64.89 #3 of 3 Archive leaderboard report
Multi-Label Text Classification EUR-Lex LAHA nDCG@5 59.28 #3 of 3 Archive leaderboard report
Multi-Label Text Classification Kan-Shan Cup LAHA P@1 54.38 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Kan-Shan Cup LAHA P@3 34.6 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Kan-Shan Cup LAHA P@5 25.88 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Kan-Shan Cup LAHA nDCG@3 51.7 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Kan-Shan Cup LAHA nDCG@5 54.65 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Wiki-30K LAHA P@1 84.18 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Wiki-30K LAHA P@3 73.14 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Wiki-30K LAHA P@5 62.87 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Wiki-30K LAHA nDCG@3 75.64 #1 of 1 Archive leaderboard report
Multi-Label Text Classification Wiki-30K LAHA nDCG@5 67.82 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections