Papers › Recurrent Neural Network-Based Sentence Encoder with Gated Attention for Natural...

Recurrent Neural Network-Based Sentence Encoder with Gated Attention for Natural Language Inference

4 Aug 2017WS 2017 9arXiv:1708.01353archive 2025-07-28

Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Si Wei, Hui Jiang, Diana Inkpen

The RepEval 2017 Shared Task aims to evaluate natural language understanding models for sentence representation, in which a sentence is represented as a fixed-length vector with neural networks and the quality of the representation is tested with a natural language inference task. This paper describes our system (alpha) that is ranked among the top in the Shared Task, on both the in-domain test set (obtaining a 74.9% accuracy) and on the cross-domain test set (also attaining a 74.9% accuracy), demonstrating that the model generalizes well to the cross-domain data. Our model is equipped with intra-sentence gated-attention composition which helps achieve a better performance. In addition to submitting our model to the Shared Task, we have also tested it on the Stanford Natural Language Inference (SNLI) dataset. We obtain an accuracy of 85.5%, which is the best reported result on SNLI when cross-sentence attention is not allowed, the same condition enforced in RepEval 2017.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

lukecq1231/enc_nli mentioned in paper report
eilon47/DL_Ass4 mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Natural Language InferenceNatural Language UnderstandingSentence

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Natural Language Inference SNLI 600D (300+300) Deep Gated Attn. BiLSTM encoders % Test Accuracy 85.5 #71 of 98 Archive leaderboard report
Natural Language Inference SNLI 600D (300+300) Deep Gated Attn. BiLSTM encoders % Train Accuracy 90.5 #71 of 98 Archive leaderboard report
Natural Language Inference SNLI 600D (300+300) Deep Gated Attn. BiLSTM encoders Parameters 12m #71 of 98 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections