Papers › Reading and Thinking: Re-read LSTM Unit for Textual Entailment Recognition

Reading and Thinking: Re-read LSTM Unit for Textual Entailment Recognition

1 Dec 2016COLING 2016 12archive 2025-07-28

Lei Sha, Baobao Chang, Zhifang Sui, Sujian Li

Recognizing Textual Entailment (RTE) is a fundamentally important task in natural language processing that has many applications. The recently released Stanford Natural Language Inference (SNLI) corpus has made it possible to develop and evaluate deep neural network methods for the RTE task. Previous neural network based methods usually try to encode the two sentences (premise and hypothesis) and send them together into a multi-layer perceptron to get their entailment type, or use LSTM-RNN to link two sentences together while using attention mechanic to enhance the model{'}s ability. In this paper, we propose to use the re-read mechanic, which means to read the premise again and again while reading the hypothesis. After read the premise again, the model can get a better understanding of the premise, which can also affect the understanding of the hypothesis. On the contrary, a better understanding of the hypothesis can also affect the understanding of the premise. With the alternative re-read process, the model can {``}think{''} of a better decision of entailment type. We designed a new LSTM unit called re-read LSTM (rLSTM) to implement this {``}thinking{''} process. Experiments show that we achieve results better than current state-of-the-art equivalents.

PaperPDFConference PDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Information RetrievalMachine TranslationNatural Language InferenceQuestion AnsweringRTEWord Alignment

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Natural Language Inference SNLI 300D re-read LSTM % Test Accuracy 87.5 #44 of 98 Archive leaderboard report
Natural Language Inference SNLI 300D re-read LSTM % Train Accuracy 90.7 #44 of 98 Archive leaderboard report
Natural Language Inference SNLI 300D re-read LSTM Parameters 2.0m #44 of 98 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

LSTMSigmoid ActivationTanh Activation

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections