{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-knowledge-hunting-framework-for-common","title":"A Knowledge Hunting Framework for Common Sense Reasoning","arxiv_id":"1810.01375","date":"2018-10-02","proceeding":"EMNLP 2018 10","authors":["Ali Emami","Noelia De La Cruz","Adam Trischler","Kaheer Suleman","Jackie Chi Kit Cheung"],"abstract":"We introduce an automatic system that achieves state-of-the-art results on\nthe Winograd Schema Challenge (WSC), a common sense reasoning task that\nrequires diverse, complex forms of inference and knowledge. Our method uses a\nknowledge hunting module to gather text from the web, which serves as evidence\nfor candidate problem resolutions. Given an input problem, our system generates\nrelevant queries to send to a search engine, then extracts and classifies\nknowledge from the returned results and weighs them to make a resolution. Our\napproach improves F1 performance on the full WSC by 0.21 over the previous best\nand represents the first system to exceed 0.5 F1. We further demonstrate that\nthe approach is competitive on the Choice of Plausible Alternatives (COPA)\ntask, which suggests that it is generally applicable.","url_abs":"http://arxiv.org/abs/1810.01375v1","url_pdf":"http://arxiv.org/pdf/1810.01375v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"common-sense-reasoning","task_name":"Common Sense Reasoning"},{"task_slug":"coreference-resolution","task_name":"Coreference Resolution"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/coreference-resolution-on-winograd-schema","task":"Coreference Resolution","dataset":"Winograd Schema Challenge","model":"Knowledge Hunter","rank_in_archive_order":66,"of":82,"metrics":{"Accuracy":"57.1"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1810.01375","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}