Papers › Learning Recurrent Span Representations for Extractive Question Answering

Learning Recurrent Span Representations for Extractive Question Answering

4 Nov 2016arXiv:1611.01436archive 2025-07-28

Kenton Lee, Shimi Salant, Tom Kwiatkowski, Ankur Parikh, Dipanjan Das, Jonathan Berant

The reading comprehension task, that asks questions about a given evidence document, is a central problem in natural language understanding. Recent formulations of this task have typically focused on answer selection from a set of candidates pre-defined manually or through the use of an external NLP pipeline. However, Rajpurkar et al. (2016) recently released the SQuAD dataset in which the answers can be arbitrary strings from the supplied text. In this paper, we focus on this answer extraction task, presenting a novel model architecture that efficiently builds fixed length representations of all spans in the evidence document with a recurrent network. We show that scoring explicit span representations significantly improves performance over other approaches that factor the prediction into separate predictions about words or start and end markers. Our approach improves upon the best published results of Wang & Jiang (2016) by 5% and decreases the error of Rajpurkar et al.'s baseline by > 50%.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

asadovsky/nn mentioned on GitHubtf report
shimisalant/RaSoR mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Answer SelectionExtractive Question-AnsweringNatural Language UnderstandingQuestion AnsweringReading Comprehension

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Question Answering SQuAD1.1 RaSoR (single model) EM 70.849 #157 of 213 Archive leaderboard report
Question Answering SQuAD1.1 RaSoR (single model) F1 78.741 #157 of 213 Archive leaderboard report
Question Answering SQuAD1.1 dev RASOR EM 66.4 #43 of 55 Archive leaderboard report
Question Answering SQuAD1.1 dev RASOR F1 74.9 #43 of 55 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections