{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/alfworld-aligning-text-and-embodied","title":"ALFWorld: Aligning Text and Embodied Environments for Interactive Learning","arxiv_id":"2010.03768","date":"2020-10-08","proceeding":null,"authors":["Mohit Shridhar","Xingdi Yuan","Marc-Alexandre Côté","Yonatan Bisk","Adam Trischler","Matthew Hausknecht"],"abstract":"Given a simple request like Put a washed apple in the kitchen fridge, humans can reason in purely abstract terms by imagining action sequences and scoring their likelihood of success, prototypicality, and efficiency, all without moving a muscle. Once we see the kitchen in question, we can update our abstract plans to fit the scene. Embodied agents require the same abilities, but existing work does not yet provide the infrastructure necessary for both reasoning abstractly and executing concretely. We address this limitation by introducing ALFWorld, a simulator that enables agents to learn abstract, text based policies in TextWorld (C\\^ot\\'e et al., 2018) and then execute goals from the ALFRED benchmark (Shridhar et al., 2020) in a rich visual environment. ALFWorld enables the creation of a new BUTLER agent whose abstract knowledge, learned in TextWorld, corresponds directly to concrete, visually grounded actions. In turn, as we demonstrate empirically, this fosters better agent generalization than training only in the visually grounded environment. BUTLER's simple, modular design factors the problem to allow researchers to focus on models for improving every piece of the pipeline (language understanding, planning, navigation, and visual scene understanding).","url_abs":"https://arxiv.org/abs/2010.03768v2","url_pdf":"https://arxiv.org/pdf/2010.03768v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"alfworld-aligning-text-and-embodied","repo_url":"https://github.com/alfworld/alfworld","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"alfworld-aligning-text-and-embodied","repo_url":"https://github.com/yenchehsiao/autonomousllmagentwithadaptingplanning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"natural-language-visual-grounding","task_name":"Natural Language Visual Grounding"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"}],"methods":[],"datasets_introduced":[{"slug":"alfworld","name":"ALFWorld","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2010.03768","atlas_url":"https://app.syntology.ai/?focus=2010.03768","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.03768"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yenchehsiao/autonomousllmagentwithadaptingplanning","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/alfworld/alfworld","reach":null}],"summary":{"ran":7,"ran_draft_wrong":3,"ran_honours":1,"unverified":3},"by_repo_kind":{"official":{"samples":14,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"42db735ed71ca183","entry":"BoxFeaturesFC","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42db735ed71ca183"}},{"code_sha256_prefix":"676a78e4b2463f42","entry":"CQAttention","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"676a78e4b2463f42"}},{"code_sha256_prefix":"eaa6cae4d498c74a","entry":"DecoderBlock","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eaa6cae4d498c74a"}},{"code_sha256_prefix":"189fed4e56b7291e","entry":"DepthwiseSeparableConv","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"189fed4e56b7291e"}},{"code_sha256_prefix":"a81a851773abf04b","entry":"NoisyLinear","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a81a851773abf04b"}},{"code_sha256_prefix":"b12dcd1f191784bb","entry":"PointerSoftmax","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b12dcd1f191784bb"}},{"code_sha256_prefix":"6dda823ca190d07a","entry":"PosEncoder","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6dda823ca190d07a"}},{"code_sha256_prefix":"540b60f3c35ddb5c","entry":"ScaledDotProductAttention","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"540b60f3c35ddb5c"}},{"code_sha256_prefix":"91eb0af694a5d554","entry":"compute_mask","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"91eb0af694a5d554"}},{"code_sha256_prefix":"91d294d891ea41db","entry":"get_timing_signal","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"91d294d891ea41db"}},{"code_sha256_prefix":"e5002de1b930b693","entry":"masked_softmax","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e5002de1b930b693"}},{"code_sha256_prefix":"72bcf63ba171e486","entry":"EncoderBlock","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"72bcf63ba171e486"}},{"code_sha256_prefix":"2ee19fbc662f9365","entry":"Policy","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ee19fbc662f9365"}},{"code_sha256_prefix":"4b8de7bded2e4118","entry":"SelfAttention","repo":"alfworld/alfworld","repo_kind":"official","path":"alfworld/agents/modules/model.py","file_url":"https://github.com/alfworld/alfworld/blob/HEAD/alfworld/agents/modules/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4b8de7bded2e4118"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}