{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2607-23519","title":"Auditing Alignment Controllability in LLMs via Political Axes","arxiv_id":"2607.23519","date":"2026-07-26","proceeding":null,"authors":["Bartol Bućan","Nikola Sočec","Sarah Isufi","Morena Granić","Luka Hobor","Agneza Krajna","Mihael Kovac","Mario Brcic"],"abstract":"Political audits of large language models (LLMs) usually reduce each to one point on a political compass. But that resting point barely matters in deployment: a model must land somewhere, and what counts is how far, and in which directions, its answers can be steered. That steering runs through the system prompt: the personalization layer a platform sets, or one induced from a user's history, not necessarily written by hand. We run a dispersion-first stress test of prompt-based controllability across 12 ideological personas plus an unsteered baseline, 70 Political Compass items, ten replicates, and seven leading LLMs: GPT-5, Claude, Grok, Gemini, DeepSeek, Kimi, and Qwen (63,700 responses). Contextual framing explains roughly 88%-93% of variance on the economic and society axes, model identity under 3%: responses are highly instruction-adjustable. Models do not shift alike: some move more, and some saturate under extreme framings. Conflicting directional-steering results in prior audits resolve once baselines are recognized as non-centered: displacement and proximity diverge, so the effect is geometric, not differential compliance. Under authoritarian prompts, models produce similar shifts on the same questions. Political-coordinate audits therefore need steerability audits reporting dispersion, symmetry, saturation, and refusal floors. We release prompts, benchmark data, and code.","url_abs":"https://arxiv.org/abs/2607.23519","url_pdf":"https://arxiv.org/pdf/2607.23519","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2607.23519"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mbrcic/llm-political-steerability","reach":null}],"summary":{"ran":14,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":17,"ran":14,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e138e6d169cd6c8f","entry":"calculate_scores","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/01_collect/collect.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/01_collect/collect.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e138e6d169cd6c8f"}},{"code_sha256_prefix":"c94a5e81b35313c8","entry":"call_once","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/01_collect/collect.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/01_collect/collect.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c94a5e81b35313c8"}},{"code_sha256_prefix":"0b70c4ac9c9a6d88","entry":"classify_response","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_r3_ablations.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_r3_ablations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b70c4ac9c9a6d88"}},{"code_sha256_prefix":"c3eef67f6bcb2454","entry":"derive_counters","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_core.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_core.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c3eef67f6bcb2454"}},{"code_sha256_prefix":"a10952157adf7c37","entry":"discover_batches","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_r3_ablations.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_r3_ablations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a10952157adf7c37"}},{"code_sha256_prefix":"c65574928f9a5bd5","entry":"model_short","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_compound_pilot.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_compound_pilot.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c65574928f9a5bd5"}},{"code_sha256_prefix":"bcbcfcee1dc27141","entry":"parse_response","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/01_collect/collect.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/01_collect/collect.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bcbcfcee1dc27141"}},{"code_sha256_prefix":"66bc94ad756f390a","entry":"process","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_core.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_core.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"66bc94ad756f390a"}},{"code_sha256_prefix":"736c329d7bf2a2da","entry":"rebucket_subtypes","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_compound_pilot.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_compound_pilot.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"736c329d7bf2a2da"}},{"code_sha256_prefix":"ed3746f8d42a8d76","entry":"rebucket_subtypes","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_compound_pilot_scty.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_compound_pilot_scty.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ed3746f8d42a8d76"}},{"code_sha256_prefix":"75738d11f0665d0b","entry":"recompute","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_r3_ablations.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_r3_ablations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75738d11f0665d0b"}},{"code_sha256_prefix":"442864c004724378","entry":"recompute_cell_percentages","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_core.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_core.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"442864c004724378"}},{"code_sha256_prefix":"3b33de2843a671f2","entry":"recompute_cell_percentages","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_compound_pilot.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_compound_pilot.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b33de2843a671f2"}},{"code_sha256_prefix":"4136de47de50607d","entry":"recompute_cell_percentages","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/02_process/process_compound_pilot_scty.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/02_process/process_compound_pilot_scty.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4136de47de50607d"}},{"code_sha256_prefix":"3f00153f9d94c3f2","entry":"main","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/01_collect/bundle_compound_pilot_raw.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/01_collect/bundle_compound_pilot_raw.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3f00153f9d94c3f2"}},{"code_sha256_prefix":"bec89bcd5c26b16a","entry":"main","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"ingestion/01_collect/bundle_compound_pilot_scty_raw.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/ingestion/01_collect/bundle_compound_pilot_scty_raw.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bec89bcd5c26b16a"}},{"code_sha256_prefix":"52a1443b1a45f0da","entry":"run_script","repo":"mbrcic/llm-political-steerability","repo_kind":"found_in_text","path":"analysis/run_all.py","file_url":"https://github.com/mbrcic/llm-political-steerability/blob/HEAD/analysis/run_all.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52a1443b1a45f0da"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}