{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/text-tuple-table-towards-information","title":"Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction","arxiv_id":"2404.14215","date":"2024-04-22","proceeding":null,"authors":["Zheye Deng","Chunkit Chan","Weiqi Wang","Yuxi Sun","Wei Fan","Tianshi Zheng","Yauwai Yim","Yangqiu Song"],"abstract":"The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream tasks, such as text summarization and text mining. Previous approaches often generate tables that directly replicate information from the text, limiting their applicability in broader contexts, as text-to-table generation in real-life scenarios necessitates information extraction, reasoning, and integration. However, there is a lack of both datasets and methodologies towards this task. In this paper, we introduce LiveSum, a new benchmark dataset created for generating summary tables of competitions based on real-time commentary texts. We evaluate the performances of state-of-the-art LLMs on this task in both fine-tuning and zero-shot settings, and additionally propose a novel pipeline called $T^3$(Text-Tuple-Table) to improve their performances. Extensive experimental results demonstrate that LLMs still struggle with this task even after fine-tuning, while our approach can offer substantial performance gains without explicit training. Further analyses demonstrate that our method exhibits strong generalization abilities, surpassing previous approaches on several other text-to-table datasets. Our code and data can be found at https://github.com/HKUST-KnowComp/LiveSum.","url_abs":"https://arxiv.org/abs/2404.14215v2","url_pdf":"https://arxiv.org/pdf/2404.14215v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"text-tuple-table-towards-information","repo_url":"https://github.com/hiyouga/llama-factory","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"text-tuple-table-towards-information","repo_url":"https://github.com/hkust-knowcomp/livesum","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"text-tuple-table-towards-information","repo_url":"https://github.com/hkust-knowcomp/livesum-ttt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"text-summarization","task_name":"Text Summarization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.14215","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.14215"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hkust-knowcomp/livesum","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hkust-knowcomp/livesum-ttt","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hiyouga/llama-factory","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/gersteinlab/Struc-Bench","reach":{"status":"ok"}}],"summary":{"ran":7,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1},"found_in_text":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"521c5eaf15e4461e","entry":"difflib_similarity","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/html_scores.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/html_scores.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"521c5eaf15e4461e"}},{"code_sha256_prefix":"db5ab71619a96eda","entry":"evaluate","repo":"hkust-knowcomp/livesum","repo_kind":"official","path":"evaluate.py","file_url":"https://github.com/hkust-knowcomp/livesum/blob/HEAD/evaluate.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"db5ab71619a96eda"}},{"code_sha256_prefix":"3fd6909a0cf91c84","entry":"find_idx_after","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/table_scores.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/table_scores.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3fd6909a0cf91c84"}},{"code_sha256_prefix":"3c6efc3e854342ed","entry":"hash_model","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/D2T/prism.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/D2T/prism.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c6efc3e854342ed"}},{"code_sha256_prefix":"3df628187afa9acf","entry":"levenshtein_similarity","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/html_scores.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/html_scores.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3df628187afa9acf"}},{"code_sha256_prefix":"8b3846aabf2bb7ef","entry":"read_file_to_list","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/D2T/utils.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/D2T/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8b3846aabf2bb7ef"}},{"code_sha256_prefix":"1ab147c8cefa1585","entry":"read_pickle","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/D2T/utils.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/D2T/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1ab147c8cefa1585"}},{"code_sha256_prefix":"e7166f45e5a6fb2a","entry":"truncate","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/D2T/moverscore.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/D2T/moverscore.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e7166f45e5a6fb2a"}},{"code_sha256_prefix":"25616abbbb04af98","entry":"build_simple_tree","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/html_scores.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/html_scores.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"25616abbbb04af98"}},{"code_sha256_prefix":"88e29bf59e677378","entry":"capitalize_sents","repo":"gersteinlab/Struc-Bench","repo_kind":"found_in_text","path":"score/D2T/utils.py","file_url":"https://github.com/gersteinlab/Struc-Bench/blob/HEAD/score/D2T/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"88e29bf59e677378"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}