{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/improving-natural-language-interaction-with","title":"Improving Natural Language Interaction with Robots Using Advice","arxiv_id":"1905.04655","date":"2019-05-12","proceeding":"NAACL 2019 6","authors":["Nikhil Mehta","Dan Goldwasser"],"abstract":"Over the last few years, there has been growing interest in learning models for physically grounded language understanding tasks, such as the popular blocks world domain. These works typically view this problem as a single-step process, in which a human operator gives an instruction and an automated agent is evaluated on its ability to execute it. In this paper we take the first step towards increasing the bandwidth of this interaction, and suggest a protocol for including advice, high-level observations about the task, which can help constrain the agent's prediction. We evaluate our approach on the blocks world task, and show that even simple advice can help lead to significant performance improvements. To help reduce the effort involved in supplying the advice, we also explore model self-generated advice which can still improve results.","url_abs":"https://arxiv.org/abs/1905.04655v1","url_pdf":"https://arxiv.org/pdf/1905.04655v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"improving-natural-language-interaction-with","repo_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1905.04655","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.04655"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","reach":null}],"summary":{"ran_honours":2,"ran_violates":1,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d4f0ef4105abb104","entry":"determineSpatial","repo":"hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","repo_kind":"official","path":"BaselineModelAdvice.py","file_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice/blob/HEAD/BaselineModelAdvice.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d4f0ef4105abb104"}},{"code_sha256_prefix":"88468f835de6f223","entry":"determine_advice_region","repo":"hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","repo_kind":"official","path":"PreTrainedModel.py","file_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice/blob/HEAD/PreTrainedModel.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"88468f835de6f223"}},{"code_sha256_prefix":"97ad4ba4985d05ba","entry":"determine_self_generated_spatial_accurate","repo":"hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","repo_kind":"official","path":"BaselineModelAdvice.py","file_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice/blob/HEAD/BaselineModelAdvice.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"97ad4ba4985d05ba"}},{"code_sha256_prefix":"12e72d044513917a","entry":"generate_advice_given_target","repo":"hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","repo_kind":"official","path":"PreTrainedModel.py","file_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice/blob/HEAD/PreTrainedModel.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"12e72d044513917a"}},{"code_sha256_prefix":"ed848c09a5f8aa42","entry":"calculate_accuracy_self_generated","repo":"hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","repo_kind":"official","path":"BaselineModelAdvice.py","file_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice/blob/HEAD/BaselineModelAdvice.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ed848c09a5f8aa42"}},{"code_sha256_prefix":"99196e8ebf389fc3","entry":"load_data","repo":"hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice","repo_kind":"official","path":"BaselineModel.py","file_url":"https://github.com/hockeybro12/Improving-NaturalLanguageInteractionWithRobots-Advice/blob/HEAD/BaselineModel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"99196e8ebf389fc3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}