{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/merging-weak-and-active-supervision-for","title":"Merging Weak and Active Supervision for Semantic Parsing","arxiv_id":"1911.12986","date":"2019-11-29","proceeding":null,"authors":["Ansong Ni","Pengcheng Yin","Graham Neubig"],"abstract":"A semantic parser maps natural language commands (NLs) from the users to executable meaning representations (MRs), which are later executed in certain environment to obtain user-desired results. The fully-supervised training of such parser requires NL/MR pairs, annotated by domain experts, which makes them expensive to collect. However, weakly-supervised semantic parsers are learnt only from pairs of NL and expected execution results, leaving the MRs latent. While weak supervision is cheaper to acquire, learning from this input poses difficulties. It demands that parsers search a large space with a very weak learning signal and it is hard to avoid spurious MRs that achieve the correct answer in the wrong way. These factors lead to a performance gap between parsers trained in weakly- and fully-supervised setting. To bridge this gap, we examine the intersection between weak supervision and active learning, which allows the learner to actively select examples and query for manual annotations as extra supervision to improve the model trained under weak supervision. We study different active learning heuristics for selecting examples to query, and various forms of extra supervision for such queries. We evaluate the effectiveness of our method on two different datasets. Experiments on the WikiSQL show that by annotating only 1.8% of examples, we improve over a state-of-the-art weakly-supervised baseline by 6.4%, achieving an accuracy of 79.0%, which is only 1.3% away from the model trained with full supervision. Experiments on WikiTableQuestions with human annotators show that our method can improve the performance with only 100 active queries, especially for weakly-supervised parsers learnt from a cold start.","url_abs":"https://arxiv.org/abs/1911.12986v1","url_pdf":"https://arxiv.org/pdf/1911.12986v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"merging-weak-and-active-supervision-for","repo_url":"https://github.com/niansong1996/wassp","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"active-learning","task_name":"Active Learning"},{"task_slug":"semantic-parsing","task_name":"Semantic Parsing"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1911.12986","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.12986"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/niansong1996/wassp","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":11},"by_repo_kind":{"official":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c3104e5e2d8a40e4","entry":"attn_sum_bahdanau","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/tf_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/tf_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c3104e5e2d8a40e4"}},{"code_sha256_prefix":"f1f2fe840e5c928e","entry":"attn_sum_dot","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/tf_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/tf_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f1f2fe840e5c928e"}},{"code_sha256_prefix":"9073ba6a227f3a75","entry":"bleu_score","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/nlp_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/nlp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9073ba6a227f3a75"}},{"code_sha256_prefix":"ba6719f38bfb57e9","entry":"create_lm_inputs_labels","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/data_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ba6719f38bfb57e9"}},{"code_sha256_prefix":"42891135110a96ff","entry":"create_multilayer_fnn","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/graph_factory.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/graph_factory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"42891135110a96ff"}},{"code_sha256_prefix":"451d8aadbc0755dd","entry":"create_seq2seq_inputs","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/data_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"451d8aadbc0755dd"}},{"code_sha256_prefix":"ee764e83c41c8784","entry":"create_seq_mse_loss","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/graph_factory.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/graph_factory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ee764e83c41c8784"}},{"code_sha256_prefix":"54fb9ba175e6c08b","entry":"edit_distance","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/nlp_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/nlp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"54fb9ba175e6c08b"}},{"code_sha256_prefix":"cc1113db8b905bd0","entry":"tensormul","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/tf_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/tf_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc1113db8b905bd0"}},{"code_sha256_prefix":"4fb20ccedc18c760","entry":"tokenize","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/nlp_utils.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/nlp_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4fb20ccedc18c760"}},{"code_sha256_prefix":"d34fbdeb6f1be262","entry":"with_graph_variable_scope","repo":"niansong1996/wassp","repo_kind":"official","path":"nsm/graph_factory.py","file_url":"https://github.com/niansong1996/wassp/blob/HEAD/nsm/graph_factory.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d34fbdeb6f1be262"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}