Browse State-of-the-Art › Slot Filling
Slot Filling
140 papers with code · 14 benchmarks · 27 datasets archive 2025-07-28
The goal of Slot Filling is to identify from a running dialog different slots, which correspond to different parameters of the user’s query. For instance, when a user queries for nearby restaurants, key slots for location and preferred food are required for a dialog system to retrieve the appropriate information. Thus, the main challenge in the slot-filling task is to extract the target entity.
Source: Real-time On-Demand Crowd-powered Entity Extraction
Image credit: Robust Retrieval Augmented Generation for Zero-shot Slot Filling
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
14 leaderboard tables shown for this task, 14 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 14 until expanded.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): MixSNIPS (1 judged, 0 placed), MixATIS (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
27 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
2 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 458 · with a code link: 140 · where Syntology ran a sample: 18 (15 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (18 of 458 tagged: 15 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 5: papers 1 to 100 of 458, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
28 Feb 2019 16 repositories listed Syntology 26 ran (of which 0 constructed an object rather than computing a result; 18 with no instrument failure: 1 honoured, 0 violated, 17 with no contract checked; 8 where Syntology's instrument failed) · 6 unverified (of 32 harvested samples) · 5 pointer-only (licence)Intent classification and slot filling are two essential tasks for natural language understanding.
-
18 Apr 2022 6 repositories listed Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 1 pointer-only (licence)We present the MASSIVE dataset--Multilingual Amazon Slu resource package (SLURP) for Slot-filling, Intent classification, and Virtual assistant Evaluation.
-
6 Sep 2016 6 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition.
-
We show similar result patterns on data extracted from an online concierge service.
-
13 Apr 2023 4 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)TDT models for Speech Recognition achieve better accuracy and up to 2.
-
23 Dec 2020 4 repositories listedOpen-domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on-demand during inference (Seo et al., 2019).
-
12 Sep 2019 4 repositories listedIn this work, we introduce the the Schema-Guided Dialogue (SGD) dataset, containing over 16k multi-domain conversations spanning 16 domains.
-
25 May 2016 4 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)Additionally, in initial user studies we observed that data programming may be an easier way for non-experts to create machine learning models when training data is limited or unavailable.
-
4 Sep 2020 3 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)We test both task-specific and general baselines, evaluating downstream performance in addition to the ability of the models to provide provenance.
-
22 Dec 2018 3 repositories listedBeing able to recognize words as slots and detect the intent of an utterance has been a keen issue in natural language understanding.
-
1 Mar 2023 2 repositories listedTo evaluate the effectiveness of our benchmark, we employ state-of-the-art methods for intent detection and slot filling.
-
29 Jun 2022 2 repositories listedIn Spoken Language Understanding (SLU) the task is to extract important information from audio commands, like the intent of what a user wants the system to do and special entities like locations or numbers.
-
29 Sep 2021 2 repositories listedThis is in line with the common understanding of how multilingual models conduct transferring between languages
-
17 Sep 2021 2 repositories listedIn this work we present a slot filling approach to the task of biomedical IE, effectively replacing the need for entity and relation-specific training data, allowing us to deal with zero-shot settings.
-
31 Aug 2021 2 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)Automatically inducing high quality knowledge graphs from a given collection of documents still remains a challenging problem in AI.
-
15 May 2021 2 repositories listedTo tackle the challenge, we propose a joint learning approach, with English SLU training data and non-English auxiliary tasks from raw text, syntax and translation for transfer.
-
17 Apr 2021 2 repositories listedRecently, there has been a promising direction in evaluating language models in the same way we would evaluate knowledge bases, and the task of slot filling is the most suitable to this intent.
-
3 Jun 2020 2 repositories listedIn this paper, we present a manually annotated corpus of 10, 000 tweets containing public reports of five COVID-19 events, including positive and negative tests, deaths, denied access to testing, claimed cures and…
-
16 Sep 2019 2 repositories listedSpoken Language Understanding (SLU) mainly involves two tasks, intent detection and slot filling, which are generally modeled jointly in existing works.
-
5 Sep 2019 2 repositories listedIn our framework, we adopt a joint model with Stack-Propagation which can directly use the intent information as input for slot filling, thus to capture the intent semantic knowledge.
-
2 Aug 2019 2 repositories listedIn this paper we present DELTA, a deep learning based language technology platform.
-
30 Jun 2019 2 repositories listedThe joint model for the two tasks is becoming a tendency in SLU.
-
1 Jun 2018 2 repositories listedAttention-based recurrent neural network models for joint intent detection and slot filling have achieved the state-of-the-art performance, while they have independent attention weights.
-
1 Sep 2017 2 repositories listedThe combination of better supervised data and a more appropriate high-capacity model enables much better relation extraction performance.
-
13 Jun 2017 2 repositories listedWe show that relation extraction can be reduced to answering simple reading comprehension questions, by associating one or more natural-language questions with each relation slot.
-
7 Feb 2017 2 repositories listedWe generalize the widely-used Seq2Seq approach by conditioning responses on both conversation history and external "facts", allowing the model to be versatile and applicable in an open-domain setting.
-
20 Feb 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)While large language models demonstrate remarkable capabilities at task-specific applications through fine-tuning, extending these benefits across diverse languages is essential for broad accessibility.
-
7 Jan 2025 1 repository listedReliable slot and intent detection (SID) is crucial in natural language understanding for applications like digital assistants.
-
15 Aug 2024 1 repository listedThis paper introduces a novel approach, MIDAS, leveraging a multi-level intent, domain, and slot knowledge distillation for multi-turn NLU.
-
7 Aug 2024 1 repository listedWe present Speech-MASSIVE, a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSIVE textual corpus.
-
31 Jul 2024 1 repository listed
-
23 Apr 2024 1 repository listed
-
28 Mar 2024 1 repository listed
-
26 Mar 2024 1 repository listed
-
Uni-MIS: United Multiple Intent Spoken Language Understanding via Multi-View Intent-Slot Interaction24 Mar 2024 1 repository listed
-
4 Mar 2024 1 repository listed
-
28 Feb 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
23 Feb 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
3 Feb 2024 1 repository listed
-
14 Dec 2023 1 repository listed
-
10 Dec 2023 1 repository listed
-
3 Nov 2023 1 repository listed
-
23 Oct 2023 1 repository listed
-
20 Oct 2023 1 repository listed
-
17 Oct 2023 1 repository listed
-
16 Oct 2023 1 repository listed
-
16 Oct 2023 1 repository listed
-
13 Oct 2023 1 repository listed
-
10 Oct 2023 1 repository listed
-
9 Oct 2023 1 repository listed
-
5 Oct 2023 1 repository listed
-
28 Aug 2023 1 repository listed
-
9 Aug 2023 1 repository listed
-
1 Aug 2023 1 repository listed
-
6 Jul 2023 1 repository listed
-
6 Jul 2023 1 repository listed
-
28 May 2023 1 repository listed
-
24 May 2023 1 repository listed
-
28 Apr 2023 1 repository listed
-
3 Apr 2023 1 repository listed
-
19 Mar 2023 1 repository listed
-
2 Mar 2023 1 repository listed
-
20 Feb 2023 1 repository listed
-
10 Dec 2022 1 repository listed
-
1 Dec 2022 1 repository listed
-
11 Nov 2022 1 repository listed
-
29 Oct 2022 1 repository listed
-
21 Oct 2022 1 repository listed
-
19 Oct 2022 1 repository listed
-
7 Oct 2022 1 repository listed
-
6 Oct 2022 1 repository listed
-
1 Oct 2022 1 repository listed
-
1 Oct 2022 1 repository listed
-
21 Sep 2022 1 repository listed
-
17 Sep 2022 1 repository listed
-
9 Sep 2022 1 repository listed
-
13 Jul 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
11 Jul 2022 1 repository listed
-
2 Jul 2022 1 repository listed
-
12 Apr 2022 1 repository listed
-
9 Feb 2022 1 repository listed
-
18 Jan 2022 1 repository listed
-
22 Dec 2021 1 repository listed
-
7 Oct 2021 1 repository listed
-
27 Sep 2021 1 repository listed
-
25 Sep 2021 1 repository listed
-
16 Sep 2021 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 8 unverified (of 19 harvested samples) · 5 pointer-only (licence)
-
3 Sep 2021 1 repository listed
-
26 Aug 2021 1 repository listed
-
19 Aug 2021 1 repository listed
-
19 Jul 2021 1 repository listed
-
13 Jun 2021 1 repository listed
-
12 Jun 2021 1 repository listed
-
3 Jun 2021 1 repository listed
-
1 Jun 2021 1 repository listed
-
29 May 2021 1 repository listed
-
18 May 2021 1 repository listed
-
17 May 2021 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
5 Apr 2021 1 repository listed
-
13 Mar 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections