{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/one-solution-is-not-all-you-need-few-shot","title":"One Solution is Not All You Need: Few-Shot Extrapolation via Structured MaxEnt RL","arxiv_id":"2010.14484","date":"2020-10-27","proceeding":"NeurIPS 2020 12","authors":["Saurabh Kumar","Aviral Kumar","Sergey Levine","Chelsea Finn"],"abstract":"While reinforcement learning algorithms can learn effective policies for complex tasks, these policies are often brittle to even minor task variations, especially when variations are not explicitly provided during training. One natural approach to this problem is to train agents with manually specified variation in the training task or environment. However, this may be infeasible in practical situations, either because making perturbations is not possible, or because it is unclear how to choose suitable perturbation strategies without sacrificing performance. The key insight of this work is that learning diverse behaviors for accomplishing a task can directly lead to behavior that generalizes to varying environments, without needing to perform explicit perturbations during training. By identifying multiple solutions for the task in a single environment during training, our approach can generalize to new situations by abandoning solutions that are no longer effective and adopting those that are. We theoretically characterize a robustness set of environments that arises from our algorithm and empirically find that our diversity-driven approach can extrapolate to various changes in the environment and task.","url_abs":"https://arxiv.org/abs/2010.14484v2","url_pdf":"https://arxiv.org/pdf/2010.14484v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"one-solution-is-not-all-you-need-few-shot","repo_url":"https://github.com/egiob/diversityisallyouneed-sb3","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"all","task_name":"All"},{"task_slug":"diversity","task_name":"Diversity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2010.14484","atlas_url":"https://app.syntology.ai/?focus=2010.14484","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.14484"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/egiob/diversityisallyouneed-sb3","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":5,"unverified":2},"by_repo_kind":{"listed":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9f397819ac46d7f7","entry":"crawler_disc_on_y_legs","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/behaviour_functions.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/behaviour_functions.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9f397819ac46d7f7"}},{"code_sha256_prefix":"d832171813a56c1f","entry":"crawler_is_flying","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/behaviour_functions.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/behaviour_functions.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d832171813a56c1f"}},{"code_sha256_prefix":"82e6460bcd964905","entry":"crawler_sensor_outputs","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/behaviour_functions.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/behaviour_functions.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"82e6460bcd964905"}},{"code_sha256_prefix":"ef103f787c48beca","entry":"create_mlp","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/torch_layers.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/torch_layers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef103f787c48beca"}},{"code_sha256_prefix":"ee85c29e20e06d17","entry":"sum_independent_dims","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/distributions.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/distributions.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ee85c29e20e06d17"}},{"code_sha256_prefix":"f2ded9c22d608f44","entry":"get_actor_critic_arch","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/torch_layers.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/torch_layers.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f2ded9c22d608f44"}},{"code_sha256_prefix":"df19469790ae30d9","entry":"kl_divergence","repo":"egiob/diversityisallyouneed-sb3","repo_kind":"listed","path":"stable_baselines3/common/distributions.py","file_url":"https://github.com/egiob/diversityisallyouneed-sb3/blob/HEAD/stable_baselines3/common/distributions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df19469790ae30d9"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}