{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-06460","title":"Tone Matters: The Impact of Linguistic Tone on Hallucination in VLMs","arxiv_id":"2601.06460","date":"2026-01-10","proceeding":null,"authors":["Weihao Hong","Zhiyuan Jiang","Bingyu Shen","Xinlei Guan","Yangyi Feng","Meng Xu","Boyang Li"],"abstract":"Vision-Language Models (VLMs) are increasingly used in safety-critical applications that require reliable visual grounding. However, these models often hallucinate details that are not present in the image to satisfy user prompts. While recent datasets and benchmarks have been introduced to evaluate systematic hallucinations in VLMs, many hallucination behaviors remain insufficiently characterized. In particular, prior work primarily focuses on object presence or absence, leaving it unclear how prompt phrasing and structural constraints can systematically induce hallucinations. In this paper, we investigate how different forms of prompt pressure influence hallucination behavior. We introduce Ghost-100, a procedurally generated dataset of synthetic scenes in which key visual details are deliberately removed, enabling controlled analysis of absence-based hallucinations. Using a structured 5-Level Prompt Intensity Framework, we vary prompts from neutral queries to toxic demands and rigid formatting constraints. We evaluate three representative open-weight VLMs: MiniCPM-V 2.6-8B, Qwen2-VL-7B, and Qwen3-VL-8B. Across all three models, hallucination rates do not increase monotonically with prompt intensity. All models exhibit reductions at higher intensity levels at different thresholds, though not all show sustained reduction under maximum coercion. These results suggest that current safety alignment is more effective at detecting semantic hostility than structural coercion, revealing model-specific limitations in handling compliance pressure. Our dataset is available at: https://github.com/bli1/tone-matters","url_abs":"https://arxiv.org/abs/2601.06460","url_pdf":"https://arxiv.org/pdf/2601.06460","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2601.06460","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.06460"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/bli1/tone-matters","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":21},"by_repo_kind":{"found_in_text":{"samples":21,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"348c74308f779a92","entry":"build_transform","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl25_freeform_with_judge.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl25_freeform_with_judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"348c74308f779a92"}},{"code_sha256_prefix":"6d99e9e8f2e3988e","entry":"contains_only_safe_role_text","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/evaluation/score_split_hallucination.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/evaluation/score_split_hallucination.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d99e9e8f2e3988e"}},{"code_sha256_prefix":"f1f772b363bd357c","entry":"dynamic_preprocess","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl25_freeform_with_judge.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl25_freeform_with_judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1f772b363bd357c"}},{"code_sha256_prefix":"303d66229c292d8c","entry":"ensure_image","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_llama32v.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_llama32v.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"303d66229c292d8c"}},{"code_sha256_prefix":"123bd4795de2cf57","entry":"extract_transcript_candidate","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/evaluation/score_split_hallucination.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/evaluation/score_split_hallucination.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"123bd4795de2cf57"}},{"code_sha256_prefix":"344717ad6b134747","entry":"heuristic_affirmed","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_deepseek_vl_v2.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_deepseek_vl_v2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"344717ad6b134747"}},{"code_sha256_prefix":"bba7d5e3f33f6f17","entry":"heuristic_affirmed","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bba7d5e3f33f6f17"}},{"code_sha256_prefix":"418c40cbe3a74030","entry":"heuristic_affirmed","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma4_e4b.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma4_e4b.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"418c40cbe3a74030"}},{"code_sha256_prefix":"5e5e357ac4b0ce25","entry":"heuristic_affirmed","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl3_hf_yesno.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl3_hf_yesno.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e5e357ac4b0ce25"}},{"code_sha256_prefix":"0fb26326d29d2c76","entry":"load_annotation","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_deepseek_vl_v2.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_deepseek_vl_v2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0fb26326d29d2c76"}},{"code_sha256_prefix":"075d0415294ee05f","entry":"load_folder_absent_object_map","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/build_final_annotations.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/build_final_annotations.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"075d0415294ee05f"}},{"code_sha256_prefix":"c535a7f4683e3452","entry":"normalize_text","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/evaluation/score_hybrid_600_200.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/evaluation/score_hybrid_600_200.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c535a7f4683e3452"}},{"code_sha256_prefix":"eb0323ce43cc4647","entry":"normalize_yesno","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_deepseek_vl_v2.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_deepseek_vl_v2.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"eb0323ce43cc4647"}},{"code_sha256_prefix":"5bad390b9263eabe","entry":"normalize_yesno","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5bad390b9263eabe"}},{"code_sha256_prefix":"b71c7d1174ff2848","entry":"normalize_yesno","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma4_e4b.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_gemma4_e4b.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b71c7d1174ff2848"}},{"code_sha256_prefix":"edddff4319e48fd8","entry":"normalize_yesno","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl3_hf_yesno.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl3_hf_yesno.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"edddff4319e48fd8"}},{"code_sha256_prefix":"a0c6c995d18aeca9","entry":"parse_cat","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/evaluation/score_hybrid_600_200.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/evaluation/score_hybrid_600_200.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0c6c995d18aeca9"}},{"code_sha256_prefix":"12415e6569de77ae","entry":"parse_cat","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/evaluation/score_split_hallucination.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/evaluation/score_split_hallucination.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"12415e6569de77ae"}},{"code_sha256_prefix":"4206ef765fe5a637","entry":"parse_image_num","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/evaluation/score_hybrid_600_200.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/evaluation/score_hybrid_600_200.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4206ef765fe5a637"}},{"code_sha256_prefix":"ea93bc74640cba91","entry":"process_image_to_pixel_values","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl25_freeform_with_judge.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_internvl25_freeform_with_judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ea93bc74640cba91"}},{"code_sha256_prefix":"581b2583d3afa66f","entry":"shard_items","repo":"bli1/tone-matters","repo_kind":"found_in_text","path":"VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_qwen2_5_vl.py","file_url":"https://github.com/bli1/tone-matters/blob/HEAD/VLM_Benchmark_GitHub_Ready/benchmark/model_runners/benchmark_qwen2_5_vl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"581b2583d3afa66f"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":{"kind":"leaderboard_placements","source":"Syntology's leaderboard-shaped extractor over the paper's own arXiv-HTML tables: a model pointed at a cell, the number was read from that cell and checked against the board's metric, dataset, split and scale, and an independent check accepted the entry; not reviewed by the paper's authors or the archive's editors","extractor_model":"global.anthropic.claude-sonnet-4-5-20250929-v1:0","verifier_model":null,"prompt_sha":"fa63d4bb9d755694","coverage":{"sentence":"Syntology has checked 6,264 of the 9,581 papers on this site that are newer than the archive; results from the others appear after they are checked.","papers_newer_than_archive":9581,"papers_checked":6264},"entries":[],"not_placed":{"boards":0,"rejected_by_independent_check":0,"refused_by_a_rule":0,"check_did_not_answer":0,"proposed_without_a_cell":0,"declined_by_site":0}}}