Browse State-of-the-Art › Question Selection
Question Selection
18 papers with code · 1 benchmark · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| BIG-bench (2 rows) | Chinchilla-70B (few-shot, k=5) | Training Compute-Optimal Large Language Models | code | Syntology 8 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 31 · with a code link: 18 · where Syntology ran a sample: 3 (2 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 31 tagged: 2 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 31 of 31, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 Dec 2021 3 repositories listedLanguage modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
-
29 Mar 2022 2 repositories listed Syntology 8 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 4 pointer-only (licence)We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget.
-
17 Aug 2021 2 repositories listed Syntology official (archive's flag): 5 ran · 10 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 1 pointer-only (licence)Computerized adaptive testing (CAT) refers to a form of tests that are personalized to every student/test taker.
-
15 Jul 2019 2 repositories listedIn this paper, we formulate the task of asking clarifying questions in open-domain information-seeking conversational systems.
-
27 May 2025 1 repository listedEvaluating multimodal large language models (MLLMs) is increasingly expensive, as the growing size and cross-modality complexity of benchmarks demand significant scoring efforts.
-
20 May 2025 1 repository listedLanguage Models (LMs) have revolutionized natural language processing, enabling high-quality text generation through prompting and in-context learning.
-
19 May 2025 1 repository listedThe recent explosion of large language models (LLMs), each with its own general or specialized strengths, makes scalable, reliable benchmarking more urgent than ever.
-
12 Mar 2025 1 repository listedSecond, we compare the performance of an adaptive questionnaire that is randomly initialised with one pre-trained on synthetic data to assess their suitability for training.
-
19 Feb 2025 1 repository listedIn this paper, we propose a CPS data collection protocol and create a new CPS dataset, called PSCon, which assists product search through conversations with human-like language.
-
6 Feb 2025 1 repository listedYet, generating effective clarifying questions requires LLM agents to engage in a form of meta-cognitive reasoning, an ability LLMs may presently lack.
-
19 Nov 2024 1 repository listedRedundant and extraneous cognitive states can lead to limited transfer and negative transfer effects.
-
2 Apr 2024 1 repository listedOur findings indicate that employing the IDEAL model both as encoder and decoder, combined with a PosteriorRMSE method for question selection, significantly improves the accuracy of recommendations, achieving 74%…
-
31 Mar 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Computerized Adaptive Testing (CAT) provides an efficient and tailored method for assessing the proficiency of examinees, by dynamically adjusting test questions based on their performance.
-
18 May 2023 1 repository listedComputerized adaptive testing (CAT) is a form of personalized testing that accurately measures students' knowledge levels while reducing test length.
-
1 Jul 2022 1 repository listedWe propose a type-controlled framework for inquisitive question generation.
-
16 Jan 2021 1 repository listedIn compositional question answering, the systems should assemble several supporting evidence from the document to generate the final answer, which is more difficult than sentence-level or phrase-level QA.
-
21 Feb 2020 1 repository listedKnowledge bases (KBs) store rich yet heterogeneous entities and facts.
-
10 Oct 2016 1 repository listedWe describe an attentive encoder that combines tree-structured recursive neural networks and sequential recurrent neural networks for modelling sentence pairs.
-
TestAgent: An Adaptive and Intelligent Expert for Human Assessment3 Jun 2025 0 repositories listedAccurately assessing internal human states is key to understanding preferences, offering personalized services, and identifying challenges in real-world applications.
-
An incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting4 Sep 2024 0 repositories listedThis paper introduces a novel incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting (MCS) problems, enabling decision makers to progressively…
-
Asking More Informative Questions for Grounded Retrieval14 Nov 2023 0 repositories listedWhen a model is trying to gather information in an interactive setting, it benefits from asking informative questions.
-
Learning to Detect Interesting Anomalies28 Oct 2022 0 repositories listedAnomaly detection algorithms are typically applied to static, unchanging, data features hand-crafted by the user.
-
"What makes a question inquisitive?" A Study on Type-Controlled Inquisitive Question Generation17 May 2022 0 repositories listedWe propose a type-controlled framework for inquisitive question generation.
-
Asking Clarifying Questions Based on Negative Feedback in Conversational Search12 Jul 2021 0 repositories listedUsers often need to look through multiple search result pages or reformulate queries when they have complex information-seeking needs.
-
A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge27 Oct 2020 0 repositories listedThis paper presents the participation of NetEase Game AI Lab team for the ClariQ challenge at Search-oriented Conversational AI (SCAI) EMNLP workshop in 2020.
-
Guided Transformer: Leveraging Multiple External Sources for Representation Learning in Conversational Search13 Jun 2020 0 repositories listedAsking clarifying questions in response to ambiguous or faceted queries has been recognized as a useful technique for various information retrieval systems, especially conversational search systems with limited…
-
Optimal Clustering from Noisy Binary Feedback14 Oct 2019 0 repositories listedWe study the problem of clustering a set of items from binary user feedback.
-
Cascade Submodular Maximization: Question Selection and Sequencing in Online Personality Quiz23 Jan 2019 0 repositories listedPersonality quiz is a powerful tool that enables costumer segmentation by actively asking them questions, and marketers are using it as an effective method of generating leads and increasing e-commerce sales.
-
Playing 20 Question Game with Policy-Based Reinforcement Learning23 Aug 2018 0 repositories listedThe 20 Questions (Q20) game is a well known game which encourages deductive reasoning and creativity.
-
1 Jun 2016 0 repositories listed
-
Crowdsourcing Pareto-Optimal Object Finding by Pairwise Comparisons15 Sep 2014 0 repositories listed
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections