Browse State-of-the-Art › Text Infilling
Text Infilling
25 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Text Infilling is the task of predicting missing spans of text which are consistent with the preceding and subsequent text. Text Infilling is a generalization of the cloze task—cloze historically refers to infilling individual words.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 43 · with a code link: 25 · where Syntology ran a sample: 9 (6 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (9 of 43 tagged: 6 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 43 of 43, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
11 May 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)We show that this approach, which we call infilling by language modeling, can enable LMs to infill entire sentences effectively on three different domains: short stories, scientific abstracts, and lyrics.
-
30 Aug 2021 2 repositories listedTherefore, we propose a story-centric benchmark named LOT for evaluating Chinese long text modeling, which aggregates two understanding tasks and two generation tasks.
-
8 Apr 2021 2 repositories listedWe present a method for generating comparative summaries that highlights similarities and contradictions in input documents.
-
15 Jul 2025 1 repository listed Syntology official (archive's flag): 16 ran · 16 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 13 where Syntology's instrument failed) · 1 unverified (of 17 harvested samples) · 15 pointer-only (licence)Diffusion-based large language models (dLLMs) have recently emerged as a powerful alternative to autoregressive LLMs, offering faster inference and greater interactivity via parallel decoding and bidirectional modeling.
-
22 May 2025 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 3 pointer-only (licence)We build LaViDa by equipping DMs with a vision encoder and jointly fine-tune the combined parts for multimodal instruction following.
-
7 Nov 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)TrajGPT integrates the spatial and temporal models in a transformer architecture through a Bayesian probability model that ensures that the gaps in a visit sequence are filled in a spatiotemporally consistent manner.
-
27 May 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)Alternately, some approaches considered character-level infilling, but they relied on predicting sub-tokens in inference, yet this strategy diminished ability in character-level infilling tasks due to the large…
-
22 Feb 2024 1 repository listedBeam search with masked language models (MLMs) is challenging in part because joint probability distributions over sequences are not readily available, unlike for autoregressive models.
-
18 Jul 2023 1 repository listedIn this work, we argue that two kinds of gaps, i. e., domain gap and objective gap, hinder the transfer of knowledge from pre-training language models (PLMs) to ABSA tasks.
-
23 May 2023 1 repository listedIn this paper, we show that multilingual and Arabic monolingual LMs exhibit bias towards entities associated with Western culture.
-
21 Mar 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 5 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)Particularly, MAGVLT achieves competitive results on both zero-shot image-to-text and text-to-image generation tasks from MS-COCO by one moderate-sized model (fewer than 500M parameters) even without the use of…
-
13 Mar 2023 1 repository listedAcross 5 NLP datasets, 4 adversarial attacks, and 3 different models, MVP improves performance against adversarial substitutions by an average of 8% over standard methods and even outperforms adversarial training-based…
-
22 Oct 2022 1 repository listedCurrent prompt tuning methods mostly convert the downstream tasks to masked language modeling problems by adding cloze-style phrases and mapping all labels to verbalizations with fixed length, which has proven effective…
-
14 Oct 2022 1 repository listedMeta-path, a sequence of node types and edge types, is the core technique to embed HINs.
-
5 Oct 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)Results on antibody design benchmarks show that our model on low-resourced antibody sequence dataset provides highly diverse CDR sequences, up to more than a two-fold increase of diversity over the baselines, without…
-
30 May 2022 1 repository listedIn this work, we adapt prompt-based few-shot learning to ELECTRA and show that it outperforms masked language models in a wide range of tasks.
-
2 Apr 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)Existing reference-free metrics have obvious limitations for evaluating controlled text generation models.
-
21 Mar 2022 1 repository listedRecent work in self-supervised learning suggests that models can learn good latent representations via contrastive learning, which can be effective for discriminative tasks.
-
4 Nov 2021 1 repository listedIn our paper, we propose inductive conformal prediction (ICP) algorithms for the tasks of text infilling and part-of-speech (POS) prediction for natural language data.
-
13 Sep 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)To overcome this challenge, we used a classifier to instruct the MCMC-based models where and how to refine the candidate sentences.
-
2 Jan 2021 1 repository listedIn this paper, we generalize text infilling (e. g., masked language models) by proposing Sequence Span Rewriting (SSR) as a self-supervised sequence-to-sequence (seq2seq) pre-training objective.
-
12 Oct 2020 1 repository listed Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)Abductive and counterfactual reasoning, core abilities of everyday human cognition, require reasoning about what might have happened at time t, while conditioning on multiple contexts from the relative past and future.
-
30 Aug 2019 1 repository listedIn this paper, we present a novel method for measurably adjusting the semantics of text while preserving its sentiment and fluency, a task we call semantic text exchange.
-
26 May 2019 1 repository listedText infilling is defined as a task for filling in the missing part of a sentence or paragraph, which is suitable for many real-world natural language generation scenarios.
-
1 Jan 2019 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)Recent years have seen remarkable progress of text generation in different contexts, such as the most common setting of generating text from scratch, and the emerging paradigm of retrieval-and-rewriting.
-
Flexible-length Text Infilling for Discrete Diffusion Models16 Jun 2025 0 repositories listedDiscrete diffusion models are a new class of text generators that offer advantages such as bidirectional context use, parallelizable generation, and flexible prompting compared to autoregressive models.
-
Insertion Language Models: Sequence Generation with Arbitrary-Position Insertions9 May 2025 0 repositories listedAutoregressive models (ARMs), which predict subsequent tokens one-by-one ``from left to right,'' have achieved significant success across a wide range of sequence generation tasks.
-
Enhancing Spoken Discourse Modeling in Language Models Using Gestural Cues5 Mar 2025 0 repositories listedResearch in linguistics shows that non-verbal cues, such as gestures, play a crucial role in spoken discourse.
-
A Benchmark for Text Expansion: Datasets, Metrics, and Baselines17 Sep 2023 0 repositories listedThis work presents a new task of Text Expansion (TE), which aims to insert fine-grained modifiers into proper locations of the plain text to concretize or vivify human writings.
-
Sequence-to-Sequence Pre-training with Unified Modality Masking for Visual Document Understanding16 May 2023 0 repositories listedThis paper presents GenDoc, a general sequence-to-sequence document understanding model pre-trained with unified masking across three modalities: text, image, and layout.
-
Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models26 Oct 2022 0 repositories listed
-
A-TIP: Attribute-aware Text Infilling via Pre-trained Language Model1 Oct 2022 0 repositories listed
-
Coordination Generation via Synchronized Text-Infilling1 Oct 2022 0 repositories listed
-
Building a Knowledge-Based Dialogue System with Text Infilling1 Sep 2022 0 repositories listed
-
On the Role of Bidirectionality in Language Model Pre-Training24 May 2022 0 repositories listed
-
BiTIIMT: A Bilingual Text-infilling Method for Interactive Machine Translation1 May 2022 0 repositories listed
-
Predicting scalar diversity with context-driven uncertainty over alternatives1 May 2022 0 repositories listed
-
Generative Prompt Tuning for Relation Classification16 Nov 2021 0 repositories listed
-
Nutri-bullets Hybrid: Consensual Multi-document Summarization1 Jun 2021 0 repositories listed
-
InFillmore: Frame-Guided Language Generation with Bidirectional Context8 Mar 2021 0 repositories listed
-
Reflective Decoding: Beyond Unidirectional Generation with Off-the-Shelf Language Models16 Oct 2020 0 repositories listed
-
Decoding As Dynamic Programming For Recurrent Autoregressive Models1 May 2020 0 repositories listed
-
"Mask and Infill" : Applying Masked Language Model to Sentiment Transfer21 Aug 2019 0 repositories listed
Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections