Papers › TagRec: Automated Tagging of Questions with Hierarchical Learning Taxonomy

TagRec: Automated Tagging of Questions with Hierarchical Learning Taxonomy

3 Jul 2021arXiv:2107.10649archive 2025-07-28

Venktesh V, Mukesh Mohania, Vikram Goyal

Online educational platforms organize academic questions based on a hierarchical learning taxonomy (subject-chapter-topic). Automatically tagging new questions with existing taxonomy will help organize these questions into different classes of hierarchical taxonomy so that they can be searched based on the facets like chapter. This task can be formulated as a flat multi-class classification problem. Usually, flat classification based methods ignore the semantic relatedness between the terms in the hierarchical taxonomy and the questions. Some traditional methods also suffer from the class imbalance issues as they consider only the leaf nodes ignoring the hierarchy. Hence, we formulate the problem as a similarity-based retrieval task where we optimize the semantic relatedness between the taxonomy and the questions. We demonstrate that our method helps to handle the unseen labels and hence can be used for taxonomy tagging in the wild. In this method, we augment the question with its corresponding answer to capture more semantic information and then align the question-answer pair's contextualized embedding with the corresponding label (taxonomy) vector representations. The representations are aligned by fine-tuning a transformer based model with a loss function that is a combination of the cosine similarity and hinge rank loss. The loss function maximizes the similarity between the question-answer pair and the correct label representations and minimizes the similarity to unrelated labels. Finally, we perform experiments on two real-world datasets. We show that the proposed learning method outperforms representations learned using the multi-class classification method and other state of the art methods by 6% as measured by Recall@k. We also demonstrate the performance of the proposed method on unseen but related learning content like the learning objectives without re-training the network.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Multi-class ClassificationQuestion-Answer categorizationRetrieval

Datasets

Introduced by this paper, per the archive.

QC-Science

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Question-Answer categorization QC-Science TagRec(BERT+USE) R@10 0.92 #1 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+USE) R@15 0.95 #1 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+USE) R@20 0.96 #1 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+USE) R@5 0.86 #1 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+Sent BERT) R@10 0.93 #2 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+Sent BERT) R@15 0.95 #2 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+Sent BERT) R@20 0.97 #2 of 6 Archive leaderboard report
Question-Answer categorization QC-Science TagRec(BERT+Sent BERT) R@5 0.85 #2 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+sent2vec R@10 0.89 #3 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+sent2vec R@15 0.93 #3 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+sent2vec R@20 0.95 #3 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+sent2vec R@5 0.79 #3 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+GloVe R@10 0.87 #4 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+GloVe R@15 0.92 #4 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+GloVe R@20 0.94 #4 of 6 Archive leaderboard report
Question-Answer categorization QC-Science BERT+GloVe R@5 0.76 #4 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Twin BERT R@10 0.86 #5 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Twin BERT R@15 0.91 #5 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Twin BERT R@20 0.94 #5 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Twin BERT R@5 0.72 #5 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Pretrained Sent BERT R@10 0.40 #6 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Pretrained Sent BERT R@15 0.47 #6 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Pretrained Sent BERT R@20 0.52 #6 of 6 Archive leaderboard report
Question-Answer categorization QC-Science Pretrained Sent BERT R@5 0.30 #6 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections