{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/lstmvis-a-tool-for-visual-analysis-of-hidden","title":"LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks","arxiv_id":"1606.07461","date":"2016-06-23","proceeding":null,"authors":["Hendrik Strobelt","Sebastian Gehrmann","Hanspeter Pfister","Alexander M. Rush"],"abstract":"Recurrent neural networks, and in particular long short-term memory (LSTM)\nnetworks, are a remarkably effective tool for sequence modeling that learn a\ndense black-box hidden representation of their sequential input. Researchers\ninterested in better understanding these models have studied the changes in\nhidden state representations over time and noticed some interpretable patterns\nbut also significant noise. In this work, we present LSTMVIS, a visual analysis\ntool for recurrent neural networks with a focus on understanding these hidden\nstate dynamics. The tool allows users to select a hypothesis input range to\nfocus on local state changes, to match these states changes to similar patterns\nin a large data set, and to align these results with structural annotations\nfrom their domain. We show several use cases of the tool for analyzing specific\nhidden state properties on dataset containing nesting, phrase structure, and\nchord progressions, and demonstrate how the tool can be used to isolate\npatterns for further statistical analysis. We characterize the domain, the\ndifferent stakeholders, and their goals and tasks.","url_abs":"http://arxiv.org/abs/1606.07461v2","url_pdf":"http://arxiv.org/pdf/1606.07461v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lstmvis-a-tool-for-visual-analysis-of-hidden","repo_url":"https://github.com/HendrikStrobelt/LSTMVis","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1606.07461","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.07461"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/HendrikStrobelt/LSTMVis","reach":{"status":"ok","spdx":"BSD-3-Clause"}}],"summary":{"unverified":4},"by_repo_kind":{"listed":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1e5b5e6ab89005aa","entry":"align_forward","repo":"HendrikStrobelt/LSTMVis","repo_kind":"listed","path":"lstmdata/helper_functions.py","file_url":"https://github.com/HendrikStrobelt/LSTMVis/blob/HEAD/lstmdata/helper_functions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"1e5b5e6ab89005aa"}},{"code_sha256_prefix":"b61deb2b4887bb60","entry":"cleanup_dict","repo":"HendrikStrobelt/LSTMVis","repo_kind":"listed","path":"lstm_server.py","file_url":"https://github.com/HendrikStrobelt/LSTMVis/blob/HEAD/lstm_server.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"b61deb2b4887bb60"}},{"code_sha256_prefix":"d94d4b954a1680ec","entry":"cos_matrix_multiplication","repo":"HendrikStrobelt/LSTMVis","repo_kind":"listed","path":"lstmdata/helper_functions.py","file_url":"https://github.com/HendrikStrobelt/LSTMVis/blob/HEAD/lstmdata/helper_functions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"d94d4b954a1680ec"}},{"code_sha256_prefix":"947af76dd3a0ce3e","entry":"rle","repo":"HendrikStrobelt/LSTMVis","repo_kind":"listed","path":"lstmdata/helper_functions.py","file_url":"https://github.com/HendrikStrobelt/LSTMVis/blob/HEAD/lstmdata/helper_functions.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"BSD-3-Clause","inline_ok":true,"mcp_get_code":{"code_sha256":"947af76dd3a0ce3e"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}