Semantic Parsing

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

20 leaderboard tables shown for this task, 20 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 20 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

44 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 44 until expanded.

Subtasks archive 2025-07-28

7 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 414 papers with code (1,202 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
  2 Dec 2016 110 repositories listed Syntology ran 89 of 164 samples · 75 unverified · 90 pointer-only (licence)
  Point cloud is an important type of geometric data structure.
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
  23 Oct 2019 57 repositories listed Syntology ran 2 of 31 samples · 29 unverified
  Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP).
• Frame-Semantic Parsing with Softmax-Margin Segmental RNNs and a Syntactic Scaffold
  29 Jun 2017 10 repositories listed
  We present a new, efficient frame-semantic parser that labels semantic arguments to FrameNet predicates.
• TAPAS: Weakly Supervised Table Parsing via Pre-training
  5 Apr 2020 8 repositories listed Syntology ran 0 of 14 samples · 14 unverified
  In this paper, we present TAPAS, an approach to question answering over tables without generating logical forms.
• StructVAE: Tree-structured Latent Variable Models for Semi-supervised Semantic Parsing
  20 Jun 2018 7 repositories listed
  Semantic parsing is the task of transducing natural language (NL) utterances into formal meaning representations (MRs), commonly represented as tree structures.
• Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task
  24 Sep 2018 6 repositories listed Syntology ran 7 of 8 samples · 1 unverified · 3 pointer-only (licence)
  We define a new complex and cross-domain semantic parsing and text-to-SQL task where different complex SQL queries and databases appear in train and test sets.
• The Natural Language Decathlon: Multitask Learning as Question Answering
  20 Jun 2018 6 repositories listed Syntology ran 1 of 13 samples · 12 unverified · 4 pointer-only (licence)
  Though designed for decaNLP, MQAN also achieves state of the art results on the WikiSQL semantic parsing task in the single-task setting.
• A Syntactic Neural Model for General-Purpose Code Generation
  6 Apr 2017 6 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  We consider the problem of parsing natural language descriptions into source code written in a general-purpose programming language like Python.
• Content Enhanced BERT-based Text-to-SQL Generation
  16 Oct 2019 5 repositories listed
  We present a simple methods to leverage the table content for the BERT-based model to solve the text-to-SQL problem.
• A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualization
  4 Feb 2019 5 repositories listed Syntology ran 21 of 36 samples · 15 unverified · 33 pointer-only (licence)
  We present SQLova, the first Natural-language-to-SQL (NL2SQL) model to achieve human performance in WikiSQL dataset.
• Language to Logical Form with Neural Attention
  6 Jan 2016 5 repositories listed Syntology ran 1 of 7 samples · 6 unverified · 1 pointer-only (licence)
  Semantic parsing aims at mapping natural language to machine interpretable meaning representations.
• Binding Language Models in Symbolic Languages
  6 Oct 2022 4 repositories listed Syntology ran 2 of 3 samples · 1 unverified
  We propose Binder, a training-free neural-symbolic framework that maps the task input to a program, which (1) allows binding a unified API of language model (LM) functionalities to a programming language (e.
• Prompt Injection: Parameterization of Fixed Inputs
  31 May 2022 4 repositories listed Syntology ran 1 of 3 samples · 2 unverified
  Through these explorations, we show that PI can be a promising direction for conditioning language models, especially in scenarios with long and fixed prompts.
• TAPEX: Table Pre-training via Learning a Neural SQL Executor
  16 Jul 2021 4 repositories listed
  TAPEX addresses the data scarcity challenge via guiding the language model to mimic a SQL executor on the diverse, large-scale and high-quality synthetic corpus.
• Cityscapes-Panoptic-Parts and PASCAL-Panoptic-Parts datasets for Scene Understanding
  16 Apr 2020 4 repositories listed Syntology ran 2 of 6 samples · 4 unverified
  In this technical report, we present two novel datasets for image scene understanding.
• Break It Down: A Question Understanding Benchmark
  31 Jan 2020 4 repositories listed
  Understanding natural language questions entails the ability to break down a question into the requisite steps for computing its answer.
• RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
  10 Nov 2019 4 repositories listed Syntology ran 4 of 7 samples · 3 unverified
  The generalization challenge lies in (a) encoding the database relations in an accessible way for the semantic parser, and (b) modeling alignment between database columns and their mentions in a given query.
• SParC: Cross-Domain Semantic Parsing in Context
  5 Jun 2019 4 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 3 pointer-only (licence)
  The best model obtains an exact match accuracy of 20.
• TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation
  5 Oct 2018 4 repositories listed Syntology ran 2 of 7 samples · 5 unverified · 2 pointer-only (licence)
  We present TRANX, a transition-based neural semantic parser that maps natural language (NL) utterances into formal meaning representations (MRs).
• Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsing
  6 Jul 2018 4 repositories listed Syntology ran 0 of 15 samples · 15 unverified
  We present Memory Augmented Policy Optimization (MAPO), a simple and novel way to leverage a memory buffer of promising trajectories to reduce the variance of policy gradient estimate.
• Compositional Semantic Parsing on Semi-Structured Tables
  3 Aug 2015 4 repositories listed
  Two important aspects of semantic parsing for question answering are the breadth of the knowledge source and the depth of logical compositionality.
• OpenICL: An Open-Source Framework for In-context Learning
  6 Mar 2023 3 repositories listed
  However, the implementation of ICL is sophisticated due to the diverse retrieval and inference methods involved, as well as the varying pre-processing requirements for different models, datasets, and tasks.
• PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
  10 Sep 2021 3 repositories listed Syntology ran 4 of 7 samples · 3 unverified
  Large pre-trained language models for textual data have an unconstrained output space; at each decoding step, they can produce any of 10, 000s of sub-word tokens.
• Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
  18 Dec 2020 3 repositories listed
  Most recently, there has been significant interest in learning contextual representations for various NLP tasks, by leveraging large scale text corpora to train large neural language models with self-supervised learning…
• AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training Data
  9 Oct 2020 3 repositories listed Syntology ran 12 of 26 samples · 14 unverified · 26 pointer-only (licence)
  To demonstrate the generality of AutoQA, we also apply it to the Overnight dataset.
• Schema2QA: High-Quality and Low-Cost Q&A Agents for the Structured Web
  16 Jan 2020 3 repositories listed
  The key concept is to cover the space of possible compound queries on the database with a large number of in-domain questions synthesized with the help of a corpus of generic query templates.
• Measuring Compositional Generalization: A Comprehensive Method on Realistic Data
  20 Dec 2019 3 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  We present a large and realistic natural language question answering dataset that is constructed according to this method, and we use it to analyze the compositional generalization ability of three machine learning…
• DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
  1 Mar 2019 3 repositories listed
  We introduce a new English reading comprehension benchmark, DROP, which requires Discrete Reasoning Over the content of Paragraphs.
• NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System
  25 Feb 2018 3 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  We present new data and semantic parsing methods for the problem of mapping English sentences to Bash commands (NL2Bash).
• From Language to Programs: Bridging Reinforcement Learning and Maximum Marginal Likelihood
  25 Apr 2017 3 repositories listed
  Our goal is to learn a semantic parser that maps natural language utterances into executable programs when only indirect supervision is available: examples are labeled with the correct execution result, but not the…

Syntology lines on 19 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.