{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/hierarchical-state-space-models-for","title":"Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling","arxiv_id":"2402.10211","date":"2024-02-15","proceeding":null,"authors":["Raunaq Bhirangi","Chenyu Wang","Venkatesh Pattabiraman","Carmel Majidi","Abhinav Gupta","Tess Hellebrekers","Lerrel Pinto"],"abstract":"Reasoning from sequences of raw sensory data is a ubiquitous problem across fields ranging from medical devices to robotics. These problems often involve using long sequences of raw sensor data (e.g. magnetometers, piezoresistors) to predict sequences of desirable physical quantities (e.g. force, inertial measurements). While classical approaches are powerful for locally-linear prediction problems, they often fall short when using real-world sensors. These sensors are typically non-linear, are affected by extraneous variables (e.g. vibration), and exhibit data-dependent drift. For many problems, the prediction task is exacerbated by small labeled datasets since obtaining ground-truth labels requires expensive equipment. In this work, we present Hierarchical State-Space Models (HiSS), a conceptually simple, new technique for continuous sequential prediction. HiSS stacks structured state-space models on top of each other to create a temporal hierarchy. Across six real-world sensor datasets, from tactile-based state prediction to accelerometer-based inertial measurement, HiSS outperforms state-of-the-art sequence models such as causal Transformers, LSTMs, S4, and Mamba by at least 23% on MSE. Our experiments further indicate that HiSS demonstrates efficient scaling to smaller datasets and is compatible with existing data-filtering techniques. Code, datasets and videos can be found on https://hiss-csp.github.io.","url_abs":"https://arxiv.org/abs/2402.10211v3","url_pdf":"https://arxiv.org/pdf/2402.10211v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hierarchical-state-space-models-for","repo_url":"https://github.com/raunaqbhirangi/hiss","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"mamba","task_name":"Mamba"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"state-space-models","task_name":"State Space Models"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.10211","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.10211"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/raunaqbhirangi/hiss","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"ran":2,"ran_draft_wrong":2,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b81882decca625ee","entry":"get_num_params","repo":"raunaqbhirangi/hiss","repo_kind":"official","path":"hiss/utils/train_utils.py","file_url":"https://github.com/raunaqbhirangi/hiss/blob/HEAD/hiss/utils/train_utils.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":2,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b81882decca625ee"}},{"code_sha256_prefix":"17f4101e6a3c928f","entry":"aggregate_list_of_dicts","repo":"raunaqbhirangi/hiss","repo_kind":"official","path":"hiss/utils/data_utils.py","file_url":"https://github.com/raunaqbhirangi/hiss/blob/HEAD/hiss/utils/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"17f4101e6a3c928f"}},{"code_sha256_prefix":"b7d9d94554e93b1b","entry":"cauchy_naive","repo":"raunaqbhirangi/hiss","repo_kind":"official","path":"hiss/s4.py","file_url":"https://github.com/raunaqbhirangi/hiss/blob/HEAD/hiss/s4.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b7d9d94554e93b1b"}},{"code_sha256_prefix":"29211975823f3158","entry":"change_cf","repo":"raunaqbhirangi/hiss","repo_kind":"official","path":"hiss/tasks/ronin_task.py","file_url":"https://github.com/raunaqbhirangi/hiss/blob/HEAD/hiss/tasks/ronin_task.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"29211975823f3158"}},{"code_sha256_prefix":"e25911109ba29783","entry":"log_vandermonde_naive","repo":"raunaqbhirangi/hiss","repo_kind":"official","path":"hiss/s4.py","file_url":"https://github.com/raunaqbhirangi/hiss/blob/HEAD/hiss/s4.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e25911109ba29783"}},{"code_sha256_prefix":"7cfca855faa8e8dc","entry":"log_vandermonde_transpose_naive","repo":"raunaqbhirangi/hiss","repo_kind":"official","path":"hiss/s4.py","file_url":"https://github.com/raunaqbhirangi/hiss/blob/HEAD/hiss/s4.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7cfca855faa8e8dc"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}