{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/qtsumm-a-new-benchmark-for-query-focused","title":"QTSumm: Query-Focused Summarization over Tabular Data","arxiv_id":"2305.14303","date":"2023-05-23","proceeding":null,"authors":["Yilun Zhao","Zhenting Qi","Linyong Nan","Boyu Mi","Yixin Liu","Weijin Zou","Simeng Han","Ruizhe Chen","Xiangru Tang","Yumo Xu","Dragomir Radev","Arman Cohan"],"abstract":"People primarily consult tables to conduct data analysis or answer specific questions. Text generation systems that can provide accurate table summaries tailored to users' information needs can facilitate more efficient access to relevant data insights. Motivated by this, we define a new query-focused table summarization task, where text generation models have to perform human-like reasoning and analysis over the given table to generate a tailored summary. We introduce a new benchmark named QTSumm for this task, which contains 7,111 human-annotated query-summary pairs over 2,934 tables covering diverse topics. We investigate a set of strong baselines on QTSumm, including text generation, table-to-text generation, and large language models. Experimental results and manual analysis reveal that the new task presents significant challenges in table-to-text generation for future research. Moreover, we propose a new approach named ReFactor, to retrieve and reason over query-relevant information from tabular data to generate several natural language facts. Experimental results demonstrate that ReFactor can bring improvements to baselines by concatenating the generated facts to the model input. Our data and code are publicly available at https://github.com/yale-nlp/QTSumm.","url_abs":"https://arxiv.org/abs/2305.14303v2","url_pdf":"https://arxiv.org/pdf/2305.14303v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"qtsumm-a-new-benchmark-for-query-focused","repo_url":"https://github.com/yale-nlp/qtsumm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"qtsumm-a-new-benchmark-for-query-focused","repo_url":"https://github.com/yilunzhao/qtsumm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"query-focused-summarization","task_name":"Query-focused Summarization"},{"task_slug":"table-to-text-generation","task_name":"Table-to-Text Generation"},{"task_slug":"text-generation","task_name":"Text Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2305.14303","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.14303"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/yale-nlp/QTSumm","reach":null}],"summary":{"ran":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"7d4b997886be814e","entry":"TableLinearize","repo":"yale-nlp/QTSumm","repo_kind":"official","path":"utils/preprocess_utils.py","file_url":"https://github.com/yale-nlp/QTSumm/blob/HEAD/utils/preprocess_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7d4b997886be814e"}},{"code_sha256_prefix":"6ca54fdd25b11730","entry":"TableProcessor","repo":"yale-nlp/QTSumm","repo_kind":"official","path":"utils/preprocess_utils.py","file_url":"https://github.com/yale-nlp/QTSumm/blob/HEAD/utils/preprocess_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6ca54fdd25b11730"}},{"code_sha256_prefix":"35565246ec6e601b","entry":"TableTruncate","repo":"yale-nlp/QTSumm","repo_kind":"official","path":"utils/preprocess_utils.py","file_url":"https://github.com/yale-nlp/QTSumm/blob/HEAD/utils/preprocess_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"35565246ec6e601b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}