{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/doctr-document-transformer-for-structured","title":"DocTr: Document Transformer for Structured Information Extraction in Documents","arxiv_id":"2307.07929","date":"2023-07-16","proceeding":"ICCV 2023 1","authors":["Haofu Liao","Aruni RoyChowdhury","Weijian Li","Ankan Bansal","Yuting Zhang","Zhuowen Tu","Ravi Kumar Satzoda","R. Manmatha","Vijay Mahadevan"],"abstract":"We present a new formulation for structured information extraction (SIE) from visually rich documents. It aims to address the limitations of existing IOB tagging or graph-based formulations, which are either overly reliant on the correct ordering of input text or struggle with decoding a complex graph. Instead, motivated by anchor-based object detectors in vision, we represent an entity as an anchor word and a bounding box, and represent entity linking as the association between anchor words. This is more robust to text ordering, and maintains a compact graph for entity linking. The formulation motivates us to introduce 1) a DOCument TRansformer (DocTr) that aims at detecting and associating entity bounding boxes in visually rich documents, and 2) a simple pre-training strategy that helps learn entity detection in the context of language. Evaluations on three SIE benchmarks show the effectiveness of the proposed formulation, and the overall approach outperforms existing solutions.","url_abs":"https://arxiv.org/abs/2307.07929v1","url_pdf":"https://arxiv.org/pdf/2307.07929v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"entity-linking","task_name":"Entity Linking"},{"task_slug":"semantic-entity-labeling","task_name":"Semantic entity labeling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/entity-linking-on-funsd","task":"Entity Linking","dataset":"FUNSD","model":"DocTr","rank_in_archive_order":4,"of":7,"metrics":{"F1":"73.9"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-entity-labeling-on-funsd","task":"Semantic entity labeling","dataset":"FUNSD","model":"DocTr","rank_in_archive_order":13,"of":15,"metrics":{"F1":"84"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.07929","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}