Papers › Neural Belief Tracker: Data-Driven Dialogue State Tracking

Neural Belief Tracker: Data-Driven Dialogue State Tracking

12 Jun 2016ACL 2017 7arXiv:1606.03777archive 2025-07-28

Nikola Mrkšić, Diarmuid Ó Séaghdha, Tsung-Hsien Wen, Blaise Thomson, Steve Young

One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue. However, most current approaches have difficulty scaling to larger, more complex dialogue domains. This is due to their dependency on either: a) Spoken Language Understanding models that require large amounts of annotated training data; or b) hand-crafted lexicons for capturing some of the linguistic variation in users' language. We propose a novel Neural Belief Tracking (NBT) framework which overcomes these problems by building on recent advances in representation learning. NBT models reason over pre-trained word vectors, learning to compose them into distributed representations of user utterances and dialogue context. Our evaluation on two datasets shows that this approach surpasses past limitations, matching the performance of state-of-the-art models which rely on hand-crafted semantic lexicons and outperforming them when such lexicons are not provided.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Dialogue State TrackingRepresentation LearningSpoken Dialogue SystemsSpoken Language Understanding

Datasets

Introduced by this paper, per the archive.

Wizard-of-Oz

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Dialogue State Tracking Second dialogue state tracking challenge Neural belief tracker Area 90 #5 of 7 Archive leaderboard report
Dialogue State Tracking Second dialogue state tracking challenge Neural belief tracker Food 84 #5 of 7 Archive leaderboard report
Dialogue State Tracking Second dialogue state tracking challenge Neural belief tracker Joint 73.4 #5 of 7 Archive leaderboard report
Dialogue State Tracking Second dialogue state tracking challenge Neural belief tracker Price 94 #5 of 7 Archive leaderboard report
Dialogue State Tracking Second dialogue state tracking challenge Neural belief tracker Request 96.5 #5 of 7 Archive leaderboard report
Dialogue State Tracking Wizard-of-Oz Neural belief tracker Joint 84.4 #9 of 10 Archive leaderboard report
Dialogue State Tracking Wizard-of-Oz Neural belief tracker Request 96.5 #9 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections