{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/iter-iterative-transformer-based-entity","title":"ITER: Iterative Transformer-based Entity Recognition and Relation Extraction","arxiv_id":null,"date":"2024-11-11","proceeding":"EMNLP 2024 11","authors":["Moritz Hennen","Florian Babl","Michaela Geierhos"],"abstract":"When extracting structured information from text, recognizing entities and extracting relationships are essential. Recent advances in both tasks generate a structured representation of the information in an autoregressive manner, a time-consuming and computationally expensive approach. This naturally raises the question of whether autoregressive methods are necessary in order to achieve comparable results. In this work, we propose ITER, an efficient encoder-based relation extraction model, that performs the task in three parallelizable steps, greatly accelerating a recent language modeling approach: ITER achieves an inference throughput of over 600 samples per second for a large model on a single consumer-grade GPU. Furthermore, we achieve state-of-the-art results on the relation extraction datasets ADE and ACE05, and demonstrate competitive performance for both named entity recognition with GENIA and CoNLL03, and for relation extraction with SciERC and CoNLL04.","url_abs":"https://aclanthology.org/2024.findings-emnlp.655/","url_pdf":"https://aclanthology.org/2024.findings-emnlp.655.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"iter-iterative-transformer-based-entity","repo_url":"https://github.com/fleonce/iter","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":null,"task_name":"GPU"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"named-entity-recognition-1","task_name":"Named Entity Recognition"},{"task_slug":null,"task_name":"Relation"},{"task_slug":"relation-extraction","task_name":"Relation Extraction"},{"task_slug":"named-entity-recognition","task_name":"named-entity-recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/relation-extraction-on-ace-2005","task":"Relation Extraction","dataset":"ACE 2005","model":"ITER","rank_in_archive_order":1,"of":30,"metrics":{"Cross Sentence":"Yes","NER Micro F1":"91.6 ± 0.12","RE Micro F1":"75.1 ± 0.49","RE+ Micro F1":"71.9 ± 0.56","Sentence Encoder":"FLAN T5 3B"},"uses_additional_data":false},{"leaderboard":"/sota/relation-extraction-on-ade-corpus","task":"Relation Extraction","dataset":"Adverse Drug Events (ADE) Corpus","model":"ITER","rank_in_archive_order":1,"of":15,"metrics":{"NER Macro F1":"92.63 ± 0.89","RE+ Macro F1":"85.6 ± 1.42"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}