{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-02685","title":"Finding Belief Geometries with Sparse Autoencoders","arxiv_id":"2604.02685","date":"2026-04-03","proceeding":null,"authors":["Matthew Levinson"],"abstract":"Understanding the geometric structure of internal representations is a central goal of mechanistic interpretability. Prior work has shown that transformers trained on sequences generated by hidden Markov models encode probabilistic belief states as simplex-shaped geometries in their residual stream, with vertices corresponding to latent generative states. Whether large language models trained on naturalistic text develop analogous geometric representations remains an open question. We introduce a pipeline for discovering candidate simplex-structured subspaces in transformer representations, combining sparse autoencoders (SAEs), $k$-subspace clustering of SAE features, and simplex fitting using AANet. We validate the pipeline on a transformer trained on a multipartite hidden Markov model with known belief-state geometry. Applied to Gemma-2-9B, we identify 13 priority clusters exhibiting candidate simplex geometry ($K \\geq 3$). A key challenge is distinguishing genuine belief-state encoding from tiling artifacts: latents can span a simplex-shaped subspace without the mixture coordinates carrying predictive signal beyond any individual feature. We therefore adopt barycentric prediction as our primary discriminating test. Among the 13 priority clusters, 3 exhibit a highly significant advantage on near-vertex samples (Wilcoxon $p < 10^{-14}$) and 4 on simplex-interior samples. Together 5 distinct real clusters pass at least one split, while no null cluster passes either. One cluster, 768_596, additionally achieves the highest causal steering score in the dataset. This is the only case where passive prediction and active intervention converge. We present these findings as preliminary evidence that genuine belief-like geometry exists in Gemma-2-9B's representation space, and identify the structured evaluation that would be required to confirm this interpretation.","url_abs":"https://arxiv.org/abs/2604.02685","url_pdf":"https://arxiv.org/pdf/2604.02685","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.02685","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.02685"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/good-epic/finding-belief-geometries","reach":null}],"summary":{"unverified":11},"by_repo_kind":{"found_in_text":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":11,"samples":[{"code_sha256_prefix":"7158d131d9995a67","entry":"build_latent_assignment_list","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"aanet_pipeline/cluster_summary.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/aanet_pipeline/cluster_summary.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7158d131d9995a67"}},{"code_sha256_prefix":"4991aa216691bd5c","entry":"calculate_elbow_score","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"cluster_selection.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/cluster_selection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4991aa216691bd5c"}},{"code_sha256_prefix":"e49943a478f448db","entry":"create_geometry_catalog","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"clustering/geometries.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/clustering/geometries.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e49943a478f448db"}},{"code_sha256_prefix":"ef528118285e1fbb","entry":"delete_special_tokens","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"cluster_selection.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/cluster_selection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ef528118285e1fbb"}},{"code_sha256_prefix":"a467be6fbb0de23e","entry":"get_next_token_distribution","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"interpretation/validate_belief_states.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/interpretation/validate_belief_states.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a467be6fbb0de23e"}},{"code_sha256_prefix":"d63913c89d92585e","entry":"load_aanet_summary","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"aanet_pipeline/cluster_summary.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/aanet_pipeline/cluster_summary.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d63913c89d92585e"}},{"code_sha256_prefix":"3b8261b6582db51e","entry":"load_prepared_samples","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"interpretation/validate_belief_states.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/interpretation/validate_belief_states.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3b8261b6582db51e"}},{"code_sha256_prefix":"099ba81001e1bd6b","entry":"load_uniform_samples","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"interpretation/validate_belief_states.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/interpretation/validate_belief_states.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"099ba81001e1bd6b"}},{"code_sha256_prefix":"e30e8fe8e3e1d049","entry":"parse_aanet_descriptors","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"aanet_pipeline/cluster_summary.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/aanet_pipeline/cluster_summary.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e30e8fe8e3e1d049"}},{"code_sha256_prefix":"cb4f090e5adbc22f","entry":"select_promising_clusters","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"cluster_selection.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/cluster_selection.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cb4f090e5adbc22f"}},{"code_sha256_prefix":"4aee22baa179c945","entry":"train_aanet_model","repo":"good-epic/finding-belief-geometries","repo_kind":"found_in_text","path":"aanet_pipeline/training.py","file_url":"https://github.com/good-epic/finding-belief-geometries/blob/HEAD/aanet_pipeline/training.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4aee22baa179c945"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}