{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-03595","title":"Controllable LLM Reasoning via Sparse Autoencoder-Based Steering","arxiv_id":"2601.03595","date":"2026-01-07","proceeding":null,"authors":["Yi Fang","Wenjie Wang","Mingfeng Xue","Boyi Deng","Fengli Xu","Dayiheng Liu","Fuli Feng"],"abstract":"Large Reasoning Models (LRMs) exhibit human-like cognitive reasoning strategies (\\eg backtracking, cross-verification) during the reasoning process, which improves their performance on complex tasks. Currently, reasoning strategies are autonomously selected by LRMs themselves. However, such autonomous selection often produces inefficient or even erroneous reasoning paths. To make reasoning more reliable and flexible, it is important to develop methods for controlling reasoning strategies. Existing methods struggle to control fine-grained reasoning strategies due to conceptual entanglement in LRMs' hidden states. To address this, we leverage Sparse Autoencoders (SAEs) to decompose strategy-entangled hidden states into a disentangled feature space. To identify the few strategy-specific features from the vast pool of SAE features, we propose SAE-Steering, an efficient two-stage feature identification pipeline. SAE-Steering first recalls features that amplify the logits of strategy-specific keywords, filtering out over 99\\% of features, and then ranks the remaining features by their control effectiveness. Using the identified strategy-specific features as control vectors, SAE-Steering outperforms existing methods by over 15\\% in control effectiveness. Furthermore, controlling reasoning strategies can redirect LRMs from erroneous paths to correct ones, achieving a 7\\% absolute accuracy improvement. Our code and data are available at https://github.com/Peter-Fy/SAE-Steering.","url_abs":"https://arxiv.org/abs/2601.03595","url_pdf":"https://arxiv.org/pdf/2601.03595","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2601.03595","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.03595"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Peter-Fy/SAE-Steering","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":4},"by_repo_kind":{"found_in_text":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0c8a4581b9076f25","entry":"chat_with_llm","repo":"Peter-Fy/SAE-Steering","repo_kind":"found_in_text","path":"sae_utils.py","file_url":"https://github.com/Peter-Fy/SAE-Steering/blob/HEAD/sae_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c8a4581b9076f25"}},{"code_sha256_prefix":"9a7ffad983065141","entry":"extract_result","repo":"Peter-Fy/SAE-Steering","repo_kind":"found_in_text","path":"eval_step3_judge.py","file_url":"https://github.com/Peter-Fy/SAE-Steering/blob/HEAD/eval_step3_judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9a7ffad983065141"}},{"code_sha256_prefix":"b2dc750da8a3606d","entry":"extract_result","repo":"Peter-Fy/SAE-Steering","repo_kind":"found_in_text","path":"find_feat_stage2b_rank.py","file_url":"https://github.com/Peter-Fy/SAE-Steering/blob/HEAD/find_feat_stage2b_rank.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b2dc750da8a3606d"}},{"code_sha256_prefix":"db79530e5af78e3e","entry":"has_repeated_outputs","repo":"Peter-Fy/SAE-Steering","repo_kind":"found_in_text","path":"sae_utils.py","file_url":"https://github.com/Peter-Fy/SAE-Steering/blob/HEAD/sae_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"db79530e5af78e3e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}