Question Selection

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

18 shown of 18 papers with code (31 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Scaling Language Models: Methods, Analysis & Insights from Training Gopher
  8 Dec 2021 3 repositories listed
  Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
• Training Compute-Optimal Large Language Models
  29 Mar 2022 2 repositories listed Syntology ran 8 of 11 samples · 3 unverified · 4 pointer-only (licence)
  We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget.
• BOBCAT: Bilevel Optimization-Based Computerized Adaptive Testing
  17 Aug 2021 2 repositories listed Syntology ran 10 of 10 samples · 0 unverified · 1 pointer-only (licence)
  Computerized adaptive testing (CAT) refers to a form of tests that are personalized to every student/test taker.
• Asking Clarifying Questions in Open-Domain Information-Seeking Conversations
  15 Jul 2019 2 repositories listed
  In this paper, we formulate the task of asking clarifying questions in open-domain information-seeking conversational systems.
• AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs
  27 May 2025 1 repository listed
  Evaluating multimodal large language models (MLLMs) is increasingly expensive, as the growing size and cross-modality complexity of benchmarks demand significant scoring efforts.
• QA-prompting: Improving Summarization with Large Language Models using Question-Answering
  20 May 2025 1 repository listed
  Language Models (LMs) have revolutionized natural language processing, enabling high-quality text generation through prompting and in-context learning.
• Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models
  19 May 2025 1 repository listed
  The recent explosion of large language models (LLMs), each with its own general or specialized strengths, makes scalable, reliable benchmarking more urgent than ever.
• Adaptive political surveys and GPT-4: Tackling the cold start problem with simulated user interactions
  12 Mar 2025 1 repository listed
  Second, we compare the performance of an adaptive questionnaire that is randomly initialised with one pre-trained on synthetic data to assess their suitability for training.
• PSCon: Product Search Through Conversations
  19 Feb 2025 1 repository listed
  In this paper, we propose a CPS data collection protocol and create a new CPS dataset, called PSCon, which assists product search through conversations with human-like language.
• Active Task Disambiguation with LLMs
  6 Feb 2025 1 repository listed
  Yet, generating effective clarifying questions requires LLM agents to engage in a form of meta-cognitive reasoning, an ability LLMs may presently lack.
• Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing
  19 Nov 2024 1 repository listed
  Redundant and extraneous cognitive states can lead to limited transfer and negative transfer effects.
• Fast and Adaptive Questionnaires for Voting Advice Applications
  2 Apr 2024 1 repository listed
  Our findings indicate that employing the IDEAL model both as encoder and decoder, combined with a PosteriorRMSE method for question selection, significantly improves the accuracy of recommendations, achieving 74%…
• Survey of Computerized Adaptive Testing: A Machine Learning Perspective
  31 Mar 2024 1 repository listed Syntology ran 3 of 3 samples · 0 unverified
  Computerized Adaptive Testing (CAT) provides an efficient and tailored method for assessing the proficiency of examinees, by dynamically adjusting test questions based on their performance.
• Balancing Test Accuracy and Security in Computerized Adaptive Testing
  18 May 2023 1 repository listed
  Computerized adaptive testing (CAT) is a form of personalized testing that accurately measures students' knowledge levels while reducing test length.
• “What makes a question inquisitive?” A Study on Type-Controlled Inquisitive Question Generation
  1 Jul 2022 1 repository listed
  We propose a type-controlled framework for inquisitive question generation.
• ComQA:Compositional Question Answering via Hierarchical Graph Neural Networks
  16 Jan 2021 1 repository listed
  In compositional question answering, the systems should assemble several supporting evidence from the document to generate the final answer, which is more difficult than sentence-level or phrase-level QA.
• Crowdsourced Collective Entity Resolution with Relational Match Propagation
  21 Feb 2020 1 repository listed
  Knowledge bases (KBs) store rich yet heterogeneous entities and facts.
• Modelling Sentence Pairs with Tree-structured Attentive Encoder
  10 Oct 2016 1 repository listed
  We describe an attentive encoder that combines tree-structured recursive neural networks and sequential recurrent neural networks for modelling sentence pairs.

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.