{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/maven-a-massive-general-domain-event","title":"MAVEN: A Massive General Domain Event Detection Dataset","arxiv_id":"2004.13590","date":"2020-04-28","proceeding":"EMNLP 2020 11","authors":["Xiaozhi Wang","Ziqi Wang","Xu Han","Wangyi Jiang","Rong Han","Zhiyuan Liu","Juanzi Li","Peng Li","Yankai Lin","Jie zhou"],"abstract":"Event detection (ED), which means identifying event trigger words and classifying event types, is the first and most fundamental step for extracting event knowledge from plain text. Most existing datasets exhibit the following issues that limit further development of ED: (1) Data scarcity. Existing small-scale datasets are not sufficient for training and stably benchmarking increasingly sophisticated modern neural methods. (2) Low coverage. Limited event types of existing datasets cannot well cover general-domain events, which restricts the applications of ED models. To alleviate these problems, we present a MAssive eVENt detection dataset (MAVEN), which contains 4,480 Wikipedia documents, 118,732 event mention instances, and 168 event types. MAVEN alleviates the data scarcity problem and covers much more general event types. We reproduce the recent state-of-the-art ED models and conduct a thorough evaluation on MAVEN. The experimental results show that existing ED methods cannot achieve promising results on MAVEN as on the small datasets, which suggests that ED in the real world remains a challenging task and requires further research efforts. We also discuss further directions for general domain ED with empirical analyses. The source code and dataset can be obtained from https://github.com/THU-KEG/MAVEN-dataset.","url_abs":"https://arxiv.org/abs/2004.13590v2","url_pdf":"https://arxiv.org/pdf/2004.13590v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"maven-a-massive-general-domain-event","repo_url":"https://github.com/THU-KEG/MAVEN-dataset","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"event-detection","task_name":"Event Detection"}],"methods":[],"datasets_introduced":[{"slug":"maven","name":"MAVEN","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2004.13590","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.13590"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/THU-KEG/MAVEN-dataset","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"unverified":4},"by_repo_kind":{"official":{"samples":5,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"8e960fbb64668568","entry":"log_sum_exp","repo":"THU-KEG/MAVEN-dataset","repo_kind":"official","path":"baselines/BERT+CRF/BERT-CRF-MAVEN/crf.py","file_url":"https://github.com/THU-KEG/MAVEN-dataset/blob/HEAD/baselines/BERT%2BCRF/BERT-CRF-MAVEN/crf.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8e960fbb64668568"}},{"code_sha256_prefix":"06d672f377907b09","entry":"calculate_scores","repo":"THU-KEG/MAVEN-dataset","repo_kind":"official","path":"baselines/DMBERT/run_ee.py","file_url":"https://github.com/THU-KEG/MAVEN-dataset/blob/HEAD/baselines/DMBERT/run_ee.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"06d672f377907b09"}},{"code_sha256_prefix":"5a3c0645dfa7e189","entry":"convert_examples_to_features","repo":"THU-KEG/MAVEN-dataset","repo_kind":"official","path":"baselines/BERT+CRF/BERT-CRF-MAVEN/utils_maven.py","file_url":"https://github.com/THU-KEG/MAVEN-dataset/blob/HEAD/baselines/BERT%2BCRF/BERT-CRF-MAVEN/utils_maven.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a3c0645dfa7e189"}},{"code_sha256_prefix":"46bab0d1babecce9","entry":"get_labels","repo":"THU-KEG/MAVEN-dataset","repo_kind":"official","path":"baselines/BERT+CRF/BERT-CRF-MAVEN/utils_maven.py","file_url":"https://github.com/THU-KEG/MAVEN-dataset/blob/HEAD/baselines/BERT%2BCRF/BERT-CRF-MAVEN/utils_maven.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"46bab0d1babecce9"}},{"code_sha256_prefix":"b043657fb4636f5c","entry":"read_examples_from_file","repo":"THU-KEG/MAVEN-dataset","repo_kind":"official","path":"baselines/BERT+CRF/BERT-CRF-MAVEN/utils_maven.py","file_url":"https://github.com/THU-KEG/MAVEN-dataset/blob/HEAD/baselines/BERT%2BCRF/BERT-CRF-MAVEN/utils_maven.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b043657fb4636f5c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}