Papers › DCN+: Mixed Objective and Deep Residual Coattention for Question Answering

DCN+: Mixed Objective and Deep Residual Coattention for Question Answering

31 Oct 2017ICLR 2018 1arXiv:1711.00106archive 2025-07-28

Caiming Xiong, Victor Zhong, Richard Socher

Traditional models for question answering optimize using cross entropy loss, which encourages exact answers at the cost of penalizing nearby or overlapping answers that are sometimes equally accurate. We propose a mixed objective that combines cross entropy loss with self-critical policy learning. The objective uses rewards derived from word overlap to solve the misalignment between evaluation metric and optimization objective. In addition to the mixed objective, we improve dynamic coattention networks (DCN) with a deep residual coattention encoder that is inspired by recent work in deep self-attention and residual networks. Our proposals improve model performance across question types and input lengths, especially for long questions that requires the ability to capture long-term dependencies. On the Stanford Question Answering Dataset, our model achieves state-of-the-art results with 75.1% exact match accuracy and 83.1% F1, while the ensemble obtains 78.9% exact match accuracy and 86.0% F1.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

lmn-extracts/dcn_plus mentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Question Answering

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Question Answering SQuAD1.1 DCN+ (ensemble) EM 78.852 #81 of 213 Archive leaderboard report
Question Answering SQuAD1.1 DCN+ (ensemble) F1 85.996 #81 of 213 Archive leaderboard report
Question Answering SQuAD1.1 DCN+ (single model) EM 74.866 #125 of 213 Archive leaderboard report
Question Answering SQuAD1.1 DCN+ (single model) F1 82.806 #125 of 213 Archive leaderboard report
Question Answering SQuAD1.1 dev DCN+ (single) EM 74.5 #29 of 55 Archive leaderboard report
Question Answering SQuAD1.1 dev DCN+ (single) F1 83.1 #29 of 55 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections