TriviaQA

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 60 papers with code (124 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Longformer: The Long-Document Transformer
  10 Apr 2020 22 repositories listed Syntology ran 15 of 35 samples · 20 unverified · 5 pointer-only (licence)
  To address this limitation, we introduce the Longformer with an attention mechanism that scales linearly with sequence length, making it easy to process documents of thousands of tokens or longer.
• Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering
  2 Jul 2020 8 repositories listed
  Generative models for open domain question answering have proven to be competitive, without resorting to external knowledge.
• Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering
  10 Nov 2019 7 repositories listed Syntology ran 4 of 6 samples · 2 unverified · 4 pointer-only (licence)
  We introduce an approach for open-domain question answering (QA) that retrieves and reads a passage graph, where vertices are passages of text and edges represent relationships that are derived from an external…
• Relevance-guided Supervision for OpenQA with ColBERT
  1 Jul 2020 5 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  In much recent work, the retriever is a learned component that uses coarse-grained vector representations of questions and passages.
• Scaling Language Models: Methods, Analysis & Insights from Training Gopher
  8 Dec 2021 3 repositories listed
  Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
• TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
  9 May 2017 3 repositories listed Syntology ran 4 of 4 samples · 0 unverified
  We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples.
• LACIE: Listener-Aware Finetuning for Confidence Calibration in Large Language Models
  31 May 2024 2 repositories listed
  To calibrate both implicit and explicit confidence markers, we introduce a pragmatic, listener-aware finetuning method (LACIE) that models the listener, considering not only whether an answer is right, but whether it…
• End-to-End Training of Neural Retrievers for Open-Domain Question Answering
  2 Jan 2021 2 repositories listed
  We also explore two approaches for end-to-end supervised training of the reader and retriever components in OpenQA models.
• GenKI: Enhancing Open-Domain Question Answering with Knowledge Integration and Controllable Generation in Large Language Models
  26 May 2025 1 repository listed
  Subsequently, we introduce a novel knowledge integration model that incorporates the retrieval knowledge into instructions during fine-tuning to intensify the model.
• DragonVerseQA: Open-Domain Long-Form Context-Aware Question-Answering
  21 Dec 2024 1 repository listed
  This paper proposes a novel approach to develop an open-domain and long-form Over-The-Top (OTT) Question-Answering (QA) dataset, DragonVerseQA, specifically oriented to the fantasy universe of "House of the Dragon" and…
• KV Prediction for Improved Time to First Token
  10 Oct 2024 1 repository listed
  In our method, a small auxiliary model is used to process the prompt and produce an approximation of the KV cache used by a base model.
• Exploring Hint Generation Approaches in Open-Domain Question Answering
  24 Sep 2024 1 repository listed
  We demonstrate that hints enhance the accuracy of answers more than retrieved and generated contexts.
• FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence Selection
  12 Aug 2024 1 repository listed Syntology ran 0 of 2 samples · 2 unverified · 2 pointer-only (licence)
  Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models.
• From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data
  27 Jun 2024 1 repository listed
  Our study highlights the potential of finetuning on synthetic data for improving the performance of LLMs on longer-context tasks.
• Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
  18 Jun 2024 1 repository listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  Lastly, our research rediscovers the importance of using alignment metrics beyond simple percent alignment, showing that judges with high percent agreement can still assign vastly different scores.
• CrAM: Credibility-Aware Attention Modification in LLMs for Combating Misinformation in RAG
  17 Jun 2024 1 repository listed
  To address this issue, we explore the task of "credibility-aware RAG", in which LLMs automatically adjust the influence of retrieved documents based on their credibility scores to counteract misinformation.
• RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented Generation
  9 Jun 2024 1 repository listed
  The Retrieval Augmented Generation (RAG) framework utilizes a combination of parametric knowledge and external knowledge to demonstrate state-of-the-art performance on open-domain question answering tasks.
• Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs
  4 Jun 2024 1 repository listed Syntology ran 1 of 3 samples · 2 unverified · 3 pointer-only (licence)
  This decline can be attributed to the loss of key information during the compression process.
• Accurate and Nuanced Open-QA Evaluation Through Textual Entailment
  26 May 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  Open-domain question answering (Open-QA) is a common task for evaluating large language models (LLMs).
• LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
  25 Apr 2024 1 repository listed Syntology ran 4 of 5 samples · 1 unverified · 5 pointer-only (licence)
  We present LayerSkip, an end-to-end solution to speed-up inference of large language models (LLMs).
• Multi-Granularity Guided Fusion-in-Decoder
  3 Apr 2024 1 repository listed
  In Open-domain Question Answering (ODQA), it is essential to discern relevant contexts as evidence and avoid spurious ones among retrieved results.
• Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering
  8 Mar 2024 1 repository listed
  Open-domain question answering (ODQA) has emerged as a pivotal research spotlight in information systems.
• Unfamiliar Finetuning Examples Control How Language Models Hallucinate
  8 Mar 2024 1 repository listed Syntology ran 5 of 7 samples · 2 unverified · 7 pointer-only (licence)
  Leveraging our previous observations on controlling hallucinations, we propose an approach for learning more reliable reward models, and show that they improve the efficacy of RL factuality finetuning in long-form…
• A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Models
  9 Oct 2023 1 repository listed Syntology ran 5 of 8 samples · 3 unverified · 8 pointer-only (licence)
  For example, natural language approaches cannot be transferred to image generation.
• Generator-Retriever-Generator Approach for Open-Domain Question Answering
  21 Jul 2023 1 repository listed
  Open-domain question answering (QA) tasks usually require the retrieval of relevant information from a large corpus to generate accurate answers.
• RFiD: Towards Rational Fusion-in-Decoder for Open-Domain Question Answering
  26 May 2023 1 repository listed
  Open-Domain Question Answering (ODQA) systems necessitate a reader model capable of generating answers by simultaneously referring to multiple passages.
• Exploiting Abstract Meaning Representation for Open-Domain Question Answering
  26 May 2023 1 repository listed
  The Open-Domain Question Answering (ODQA) task involves retrieving and subsequently generating answers from fine-grained relevant passages within a database.
• Allies: Prompting Large Language Model with Beam Search
  24 May 2023 1 repository listed Syntology ran 1 of 13 samples · 12 unverified
  With the advance of large language models (LLMs), the research field of LLM applications becomes more and more popular and the idea of constructing pipelines to accomplish complex tasks by stacking LLM API calls come…
• Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback
  24 May 2023 1 repository listed
  A trustworthy real-world prediction system should produce well-calibrated confidence scores; that is, its confidence in an answer should be indicative of the likelihood that the answer is correct, enabling deferral to…
• CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
  19 May 2023 1 repository listed Syntology ran 4 of 5 samples · 1 unverified
  Unlike these models, humans typically utilize external tools to cross-check and refine their initial content, like using a search engine for fact-checking, or a code interpreter for debugging.

Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.