In-Context Learning

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 998 papers with code (2,297 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• From system models to class models: An in-context learning paradigm
  25 Aug 2023 7 repositories listed
  Is it possible to understand the intricacies of a dynamical system not solely from its input/output pattern, but also by observing the behavior of other systems within the same class?
• Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
  5 Jan 2023 7 repositories listed Syntology ran 6 of 6 samples · 0 unverified
  In addition, we find Vall-E could preserve the speaker's emotion and acoustic environment of the acoustic prompt in synthesis.
• TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second
  5 Jul 2022 7 repositories listed Syntology ran 1 of 4 samples · 3 unverified · 1 pointer-only (licence)
  We present TabPFN, a trained Transformer that can do supervised classification for small tabular datasets in less than a second, needs no hyperparameter tuning and is competitive with state-of-the-art classification…
• A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL
  13 Nov 2024 5 repositories listed
  On the other hand, we implement the ICL approach with an example selection method based on named entity recognition to prevent overemphasis on entities.
• Large Language Models Are Human-Level Prompt Engineers
  3 Nov 2022 5 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  By conditioning on natural language instructions, large language models (LLMs) have displayed impressive capabilities as general-purpose computers.
• PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation
  26 Apr 2021 5 repositories listed
  To enhance the generalization ability of PanGu-α, we collect 1.
• HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution
  27 Jun 2023 4 repositories listed Syntology ran 17 of 28 samples · 11 unverified · 1 pointer-only (licence)
  Leveraging Hyena's new long-range capabilities, we present HyenaDNA, a genomic foundation model pretrained on the human reference genome with context lengths of up to 1 million tokens at the single nucleotide-level - an…
• Data Distributional Properties Drive Emergent In-Context Learning in Transformers
  22 Apr 2022 4 repositories listed Syntology ran 3 of 9 samples · 6 unverified · 3 pointer-only (licence)
  In further experiments, we found that naturalistic data distributions were only able to elicit in-context learning in transformers, and not in recurrent models.
• RWKV-7 "Goose" with Expressive Dynamic State Evolution
  18 Mar 2025 3 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 2 pointer-only (licence)
  We present RWKV-7 "Goose", a new sequence modeling architecture with constant memory usage and constant inference time per token.
• Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences
  6 Nov 2024 3 repositories listed Syntology ran 3 of 29 samples · 26 unverified
  While Transformers have yielded impressive results, their quadratic runtime dependency on the sequence length complicates their use for long genomic sequences and in-context learning on proteins and chemical sequences.
• FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
  4 Jul 2024 3 repositories listed Syntology ran 10 of 10 samples · 0 unverified
  This report introduces FunAudioLLM, a model family designed to enhance natural voice interactions between humans and large language models (LLMs).
• Natural language guidance of high-fidelity text-to-speech with synthetic annotations
  2 Feb 2024 3 repositories listed Syntology ran 5 of 6 samples · 1 unverified · 1 pointer-only (licence)
  We propose a scalable method for labeling various aspects of speaker identity, style, and recording conditions.
• SymbolicAI: A framework for logic-based approaches combining generative models and solvers
  1 Feb 2024 3 repositories listed
  Through these operations based on in-context learning our framework enables the creation and evaluation of explainable computational graphs.
• VILA: On Pre-training for Visual Language Models
  12 Dec 2023 3 repositories listed
  Visual language models (VLMs) rapidly progressed with the recent success of large language models.
• Improving Planning with Large Language Models: A Modular Agentic Architecture
  30 Sep 2023 3 repositories listed
  To improve planning with LLMs, we propose an agentic architecture, the Modular Agentic Planner (MAP), in which planning is accomplished via the recurrent interaction of the specialized modules mentioned above, each…
• Enhancing In-Context Learning with Answer Feedback for Multi-Span Question Answering
  7 Jun 2023 3 repositories listed
  Previous researches found that in-context learning is an effective approach to exploiting LLM, by using a few task-related labeled data as demonstration examples to construct a few-shot prompt for answering new…
• Fine-Tuning Language Models with Just Forward Passes
  27 May 2023 3 repositories listed Syntology ran 9 of 17 samples · 8 unverified
  Fine-tuning language models (LMs) has yielded success on diverse downstream tasks, but as LMs grow in size, backpropagation requires a prohibitively large amount of memory.
• Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  23 May 2023 3 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  In-context learning (ICL) emerges as a promising capability of large language models (LLMs) by providing them with demonstration examples to perform diverse tasks.
• SegGPT: Segmenting Everything In Context
  6 Apr 2023 3 repositories listed Syntology ran 6 of 10 samples · 4 unverified
  We unify various segmentation tasks into a generalist in-context learning framework that accommodates different kinds of segmentation data by transforming them into the same format of images.
• OpenICL: An Open-Source Framework for In-context Learning
  6 Mar 2023 3 repositories listed
  However, the implementation of ICL is sophisticated due to the diverse retrieval and inference methods involved, as well as the varying pre-processing requirements for different models, datasets, and tasks.
• E-InMeMo: Enhanced Prompting for Visual In-Context Learning
  25 Apr 2025 2 repositories listed
  Large-scale models trained on extensive datasets have become the standard due to their strong generalizability across diverse tasks.
• Strategy Coopetition Explains the Emergence and Transience of In-Context Learning
  7 Mar 2025 2 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 6 pointer-only (licence)
  Firstly, we find that, after the disappearance of ICL, the asymptotic strategy is a remarkable hybrid between in-weights and in-context learning, which we term "context-constrained in-weights learning" (CIWL).
• JoLT: Joint Probabilistic Predictions on Tabular Data Using LLMs
  17 Feb 2025 2 repositories listed Syntology ran 0 of 19 samples · 19 unverified
  We introduce a simple method for probabilistic predictions on tabular data based on Large Language Models (LLMs) called JoLT (Joint LLM Process for Tabular data).
• Large Language Diffusion Models
  14 Feb 2025 2 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  Autoregressive models (ARMs) are widely regarded as the cornerstone of large language models (LLMs).
• RETQA: A Large-Scale Open-Domain Tabular Question Answering Dataset for Real Estate Sector
  13 Dec 2024 2 repositories listed
  To tackle these challenges, we propose the SLUTQA framework, which integrates large language models with spoken language understanding tasks to enhance retrieval and answering accuracy.
• Toward Automated Algorithm Design: A Survey and Practical Guide to Meta-Black-Box-Optimization
  1 Nov 2024 2 repositories listed
  Based on the evaluation results, we meticulously identify a set of core designs that enhance the generalization and learning effectiveness of MetaBBO.
• Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?
  31 Oct 2024 2 repositories listed Syntology ran 7 of 11 samples · 4 unverified · 11 pointer-only (licence)
  Here, we propose the method of contrastive denoising with noisy chain-of-thought (CD-CoT).
• SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
  14 Oct 2024 2 repositories listed
  We introduce Sana, a text-to-image framework that can efficiently generate images up to 4096×4096 resolution.
• Tree of Problems: Improving structured problem solving with compositionality
  9 Oct 2024 2 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  Large Language Models (LLMs) have demonstrated remarkable performance across multiple tasks through in-context learning.
• Differential Transformer
  7 Oct 2024 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Transformer tends to overallocate attention to irrelevant context.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.