Papers › MEMEN: Multi-layer Embedding with Memory Networks for Machine Comprehension
MEMEN: Multi-layer Embedding with Memory Networks for Machine Comprehension
Boyuan Pan, Hao Li, Zhou Zhao, Bin Cao, Deng Cai, Xiaofei He
Machine comprehension(MC) style question answering is a representative problem in natural language processing. Previous methods rarely spend time on the improvement of encoding layer, especially the embedding of syntactic information and name entity of the words, which are very crucial to the quality of encoding. Moreover, existing attention methods represent each query word as a vector or use a single vector to represent the whole query sentence, neither of them can handle the proper weight of the key words in query sentence. In this paper, we introduce a novel neural network architecture called Multi-layer Embedding with Memory Network(MEMEN) for machine reading task. In the encoding layer, we employ classic skip-gram model to the syntactic and semantic information of the words to train a new kind of embedding layer. We also propose a memory network of full-orientation matching of the query and passage to catch more pivotal information. Experiments show that our model has competitive results both from the perspectives of precision and efficiency in Stanford Question Answering Dataset(SQuAD) among all published results and achieves the state-of-the-art results on TriviaQA dataset.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Question Answering | SQuAD1.1 | MEMEN (single model) | EM | 78.234 | #91 of 213 | Archive leaderboard | report |
| Question Answering | SQuAD1.1 | MEMEN (single model) | F1 | 85.344 | #91 of 213 | Archive leaderboard | report |
| Question Answering | SQuAD1.1 | MEMEN (single model) | EM | 78.234 | #92 of 213 | Archive leaderboard | report |
| Question Answering | SQuAD1.1 | MEMEN (single model) | F1 | 85.344 | #92 of 213 | Archive leaderboard | report |
| Question Answering | SQuAD1.1 | MEMEN (ensemble) | EM | 75.370 | #119 of 213 | Archive leaderboard | report |
| Question Answering | SQuAD1.1 | MEMEN (ensemble) | F1 | 82.658 | #119 of 213 | Archive leaderboard | report |
| Question Answering | TriviaQA | MEMEN | EM | 43.16 | #47 of 56 | Archive leaderboard | report |
| Question Answering | TriviaQA | MEMEN | F1 | 46.90 | #47 of 56 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections