{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/learning-the-predictability-of-the-future","title":"Learning the Predictability of the Future","arxiv_id":"2101.01600","date":"2021-06-19","proceeding":"CVPR 2021 1","authors":["Dídac Surís","Ruoshi Liu","Carl Vondrick"],"abstract":"We introduce a framework for learning from unlabeled video what is predictable in the future. Instead of committing up front to features to predict, our approach learns from data which features are predictable. Based on the observation that hyperbolic geometry naturally and compactly encodes hierarchical structure, we propose a predictive model in hyperbolic space. When the model is most confident, it will predict at a concrete level of the hierarchy, but when the model is not confident, it learns to automatically select a higher level of abstraction. Experiments on two established datasets show the key role of hierarchical representations for action prediction. Although our representation is trained with unlabeled video, visualizations show that action hierarchies emerge in the representation.","url_abs":"https://arxiv.org/abs/2101.01600v1","url_pdf":"https://arxiv.org/pdf/2101.01600v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-the-predictability-of-the-future","repo_url":"https://github.com/cvlab-columbia/hyperfuture","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"self-supervised-action-recognition","task_name":"Self-Supervised Action Recognition"},{"task_slug":"video-understanding","task_name":"Video Understanding"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2101.01600","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2101.01600"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/cvlab-columbia/hyperfuture","reach":null}],"summary":{"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6160748a97004069","entry":"MobiusLinear","repo":"cvlab-columbia/hyperfuture","repo_kind":"official","path":"backbone/hyrnn_nets.py","file_url":"https://github.com/cvlab-columbia/hyperfuture/blob/HEAD/backbone/hyrnn_nets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6160748a97004069"}},{"code_sha256_prefix":"b54db5c5bc23a042","entry":"_mobius_matvec","repo":"cvlab-columbia/hyperfuture","repo_kind":"official","path":"backbone/hyrnn_nets.py","file_url":"https://github.com/cvlab-columbia/hyperfuture/blob/HEAD/backbone/hyrnn_nets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b54db5c5bc23a042"}},{"code_sha256_prefix":"d427e00559a24cab","entry":"mobius_linear","repo":"cvlab-columbia/hyperfuture","repo_kind":"official","path":"backbone/hyrnn_nets.py","file_url":"https://github.com/cvlab-columbia/hyperfuture/blob/HEAD/backbone/hyrnn_nets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d427e00559a24cab"}},{"code_sha256_prefix":"83e8bf362e443d78","entry":"mobius_matvec","repo":"cvlab-columbia/hyperfuture","repo_kind":"official","path":"backbone/hyrnn_nets.py","file_url":"https://github.com/cvlab-columbia/hyperfuture/blob/HEAD/backbone/hyrnn_nets.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"83e8bf362e443d78"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}