Papers › TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

11 Nov 2019AAAI 2020 2019 11arXiv:1911.04118archive 2025-07-28

Siddhant Garg, Thuy Vu, Alessandro Moschitti

We propose TANDA, an effective technique for fine-tuning pre-trained Transformer models for natural language tasks. Specifically, we first transfer a pre-trained model into a model for a general task by fine-tuning it with a large and high-quality dataset. We then perform a second fine-tuning step to adapt the transferred model to the target domain. We demonstrate the benefits of our approach for answer sentence selection, which is a well-known inference task in Question Answering. We built a large scale dataset to enable the transfer step, exploiting the Natural Questions dataset. Our approach establishes the state of the art on two well-known benchmarks, WikiQA and TREC-QA, achieving MAP scores of 92% and 94.3%, respectively, which largely outperform the previous highest scores of 83.4% and 87.5%, obtained in very recent work. We empirically show that TANDA generates more stable and robust models reducing the effort required for selecting optimal hyper-parameters. Additionally, we show that the transfer step of TANDA makes the adaptation step more robust to noise. This enables a more effective use of noisy datasets for fine-tuning. Finally, we also confirm the positive impact of TANDA in an industrial setting, using domain specific datasets subject to different types of noise.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

alexa/wqa_tanda officialmentioned on GitHubNOASSERTION report
samrelins/tanda_search_qa_tool mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Natural QuestionsQuestion AnsweringSentence

Datasets

Introduced by this paper, per the archive.

ASNQ

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Question Answering TrecQA TANDA-RoBERTa (ASNQ, TREC-QA) MAP 0.943 #2 of 13 Archive leaderboard report
Question Answering TrecQA TANDA-RoBERTa (ASNQ, TREC-QA) MRR 0.974 #2 of 13 Archive leaderboard report
Question Answering WikiQA TANDA-RoBERTa (ASNQ, WikiQA) MAP 0.920 #3 of 25 Archive leaderboard report
Question Answering WikiQA TANDA-RoBERTa (ASNQ, WikiQA) MRR 0.933 #3 of 25 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerReLUResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections