{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/polyie-a-dataset-of-information-extraction","title":"PolyIE: A Dataset of Information Extraction from Polymer Material Scientific Literature","arxiv_id":"2311.07715","date":"2023-11-13","proceeding":null,"authors":["Jerry Junyang Cheung","Yuchen Zhuang","Yinghao Li","Pranav Shetty","Wantian Zhao","Sanjeev Grampurohit","Rampi Ramprasad","Chao Zhang"],"abstract":"Scientific information extraction (SciIE), which aims to automatically extract information from scientific literature, is becoming more important than ever. However, there are no existing SciIE datasets for polymer materials, which is an important class of materials used ubiquitously in our daily lives. To bridge this gap, we introduce POLYIE, a new SciIE dataset for polymer materials. POLYIE is curated from 146 full-length polymer scholarly articles, which are annotated with different named entities (i.e., materials, properties, values, conditions) as well as their N-ary relations by domain experts. POLYIE presents several unique challenges due to diverse lexical formats of entities, ambiguity between entities, and variable-length relations. We evaluate state-of-the-art named entity extraction and relation extraction models on POLYIE, analyze their strengths and weaknesses, and highlight some difficult cases for these models. To the best of our knowledge, POLYIE is the first SciIE benchmark for polymer materials, and we hope it will lead to more research efforts from the community on this challenging task. Our code and data are available on: https://github.com/jerry3027/PolyIE.","url_abs":"https://arxiv.org/abs/2311.07715v1","url_pdf":"https://arxiv.org/pdf/2311.07715v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"polyie-a-dataset-of-information-extraction","repo_url":"https://github.com/jerry3027/polyie","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"articles","task_name":"Articles"},{"task_slug":"relation-extraction","task_name":"Relation Extraction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2311.07715","atlas_url":"https://app.syntology.ai/?focus=2311.07715","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.07715"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jerry3027/polyie","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":6},"by_repo_kind":{"official":{"samples":6,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"84aab1ec5a8d8500","entry":"convert_sentence_to_token_offset","repo":"jerry3027/polyie","repo_kind":"official","path":"Baselines/Bert_NER/preprocess_dataset.py","file_url":"https://github.com/jerry3027/polyie/blob/HEAD/Baselines/Bert_NER/preprocess_dataset.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"84aab1ec5a8d8500"}},{"code_sha256_prefix":"243025ce6eb1bcfe","entry":"dispatch_azure_openai_requests","repo":"jerry3027/polyie","repo_kind":"official","path":"GPT/baseline_gpt_ner.py","file_url":"https://github.com/jerry3027/polyie/blob/HEAD/GPT/baseline_gpt_ner.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"243025ce6eb1bcfe"}},{"code_sha256_prefix":"86528be2c5d83b1f","entry":"dispatch_azure_openai_requests","repo":"jerry3027/polyie","repo_kind":"official","path":"GPT/baseline_gpt_re.py","file_url":"https://github.com/jerry3027/polyie/blob/HEAD/GPT/baseline_gpt_re.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"86528be2c5d83b1f"}},{"code_sha256_prefix":"315800408c7fb937","entry":"dispatch_openai_requests","repo":"jerry3027/polyie","repo_kind":"official","path":"GPT/baseline_gpt_ner.py","file_url":"https://github.com/jerry3027/polyie/blob/HEAD/GPT/baseline_gpt_ner.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"315800408c7fb937"}},{"code_sha256_prefix":"d2de5b98fe7c085f","entry":"eval_fn","repo":"jerry3027/polyie","repo_kind":"official","path":"Baselines/Bert_NER/engine.py","file_url":"https://github.com/jerry3027/polyie/blob/HEAD/Baselines/Bert_NER/engine.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d2de5b98fe7c085f"}},{"code_sha256_prefix":"9e949368c1fecd3e","entry":"train_fn","repo":"jerry3027/polyie","repo_kind":"official","path":"Baselines/Bert_NER/engine.py","file_url":"https://github.com/jerry3027/polyie/blob/HEAD/Baselines/Bert_NER/engine.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9e949368c1fecd3e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}