{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/no-to-the-right-online-language-corrections","title":"\"No, to the Right\" -- Online Language Corrections for Robotic Manipulation via Shared Autonomy","arxiv_id":"2301.02555","date":"2023-01-06","proceeding":null,"authors":["Yuchen Cui","Siddharth Karamcheti","Raj Palleti","Nidhya Shivakumar","Percy Liang","Dorsa Sadigh"],"abstract":"Systems for language-guided human-robot interaction must satisfy two key desiderata for broad adoption: adaptivity and learning efficiency. Unfortunately, existing instruction-following agents cannot adapt, lacking the ability to incorporate online natural language supervision, and even if they could, require hundreds of demonstrations to learn even simple policies. In this work, we address these problems by presenting Language-Informed Latent Actions with Corrections (LILAC), a framework for incorporating and adapting to natural language corrections - \"to the right,\" or \"no, towards the book\" - online, during execution. We explore rich manipulation domains within a shared autonomy paradigm. Instead of discrete turn-taking between a human and robot, LILAC splits agency between the human and robot: language is an input to a learned model that produces a meaningful, low-dimensional control space that the human can use to guide the robot. Each real-time correction refines the human's control space, enabling precise, extended behaviors - with the added benefit of requiring only a handful of demonstrations to learn. We evaluate our approach via a user study where users work with a Franka Emika Panda manipulator to complete complex manipulation tasks. Compared to existing learned baselines covering both open-loop instruction following and single-turn shared autonomy, we show that our corrections-aware approach obtains higher task completion rates, and is subjectively preferred by users because of its reliability, precision, and ease of use.","url_abs":"https://arxiv.org/abs/2301.02555v1","url_pdf":"https://arxiv.org/pdf/2301.02555v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"no-to-the-right-online-language-corrections","repo_url":"https://github.com/stanford-iliad/lilac","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"instruction-following","task_name":"Instruction Following"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2301.02555","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.02555"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/stanford-iliad/lilac","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_fixture":1,"unverified":5},"by_repo_kind":{"official":{"samples":6,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"460db904f1c5c885","entry":"get_1D_sine_cosine","repo":"stanford-iliad/lilac","repo_kind":"official","path":"lilac/models/core.py","file_url":"https://github.com/stanford-iliad/lilac/blob/HEAD/lilac/models/core.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"460db904f1c5c885"}},{"code_sha256_prefix":"3e3b0bb84ad7e400","entry":"get_1D_position_embeddings","repo":"stanford-iliad/lilac","repo_kind":"official","path":"lilac/models/core.py","file_url":"https://github.com/stanford-iliad/lilac/blob/HEAD/lilac/models/core.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3e3b0bb84ad7e400"}},{"code_sha256_prefix":"aa0561ca6347151d","entry":"quat2euler","repo":"stanford-iliad/lilac","repo_kind":"official","path":"lilac/robot/utils.py","file_url":"https://github.com/stanford-iliad/lilac/blob/HEAD/lilac/robot/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa0561ca6347151d"}},{"code_sha256_prefix":"ac383198d983ebb0","entry":"quat2euler_degrees","repo":"stanford-iliad/lilac","repo_kind":"official","path":"lilac/robot/utils.py","file_url":"https://github.com/stanford-iliad/lilac/blob/HEAD/lilac/robot/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ac383198d983ebb0"}},{"code_sha256_prefix":"c463eb406394a3ab","entry":"sentence_pool","repo":"stanford-iliad/lilac","repo_kind":"official","path":"lilac/preprocessing/utils.py","file_url":"https://github.com/stanford-iliad/lilac/blob/HEAD/lilac/preprocessing/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c463eb406394a3ab"}},{"code_sha256_prefix":"5962a092cf3132f7","entry":"vec2reordered_mat","repo":"stanford-iliad/lilac","repo_kind":"official","path":"lilac/robot/utils.py","file_url":"https://github.com/stanford-iliad/lilac/blob/HEAD/lilac/robot/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5962a092cf3132f7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}