{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/options-of-interest-temporal-abstraction-with","title":"Options of Interest: Temporal Abstraction with Interest Functions","arxiv_id":"2001.00271","date":"2020-01-01","proceeding":null,"authors":["Khimya Khetarpal","Martin Klissarov","Maxime Chevalier-Boisvert","Pierre-Luc Bacon","Doina Precup"],"abstract":"Temporal abstraction refers to the ability of an agent to use behaviours of controllers which act for a limited, variable amount of time. The options framework describes such behaviours as consisting of a subset of states in which they can initiate, an internal policy and a stochastic termination condition. However, much of the subsequent work on option discovery has ignored the initiation set, because of difficulty in learning it from data. We provide a generalization of initiation sets suitable for general function approximation, by defining an interest function associated with an option. We derive a gradient-based learning algorithm for interest functions, leading to a new interest-option-critic architecture. We investigate how interest functions can be leveraged to learn interpretable and reusable temporal abstractions. We demonstrate the efficacy of the proposed approach through quantitative and qualitative results, in both discrete and continuous environments.","url_abs":"https://arxiv.org/abs/2001.00271v1","url_pdf":"https://arxiv.org/pdf/2001.00271v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"options-of-interest-temporal-abstraction-with","repo_url":"https://github.com/kkhetarpal/ioc","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"options-of-interest-temporal-abstraction-with","repo_url":"https://github.com/maximecb/gym-miniworld","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2001.00271","atlas_url":"https://app.syntology.ai/?focus=2001.00271","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2001.00271"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kkhetarpal/ioc","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/maximecb/gym-miniworld","reach":{"status":"unanswered"}}],"summary":{"ran":1},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"775be4db9f291d22","entry":"InterestFunctionGradient","repo":"kkhetarpal/ioc","repo_kind":"official","path":"tabular/interestoptioncritic_tabular_fr.py","file_url":"https://github.com/kkhetarpal/ioc/blob/HEAD/tabular/interestoptioncritic_tabular_fr.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"775be4db9f291d22"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}