{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-03314","title":"Towards Self-Robust LLMs: Intrinsic Prompt Noise Resistance via CoIPO","arxiv_id":"2603.03314","date":"2026-02-09","proceeding":null,"authors":["Xin Yang","Letian Li","Abudukelimu Wuerkaixi","Xuxin Cheng","Cao Liu","Ke Zeng","Xunliang Cai","Wenyuan Jiang"],"abstract":"Large language models (LLMs) have demonstrated remarkable and steadily improving performance across a wide range of tasks. However, LLM performance may be highly sensitive to prompt variations especially in scenarios with limited openness or strict output formatting requirements, indicating insufficient robustness. In real-world applications, user prompts provided to LLMs often contain imperfections, which may undermine the quality of the model's responses. To address this issue, previous work has primarily focused on preprocessing prompts, employing external tools or even LLMs to refine prompt formulations in advance. However, these approaches overlook the intrinsic robustness of LLMs, and their reliance on external components introduces additional computational overhead and uncertainty. In this work, we propose a Contrastive Learning-based Inverse Direct Preference Optimization (CoIPO) method that minimizes the discrepancy between the label-aligned logits produced by the model under a clean prompt and its noisy counterpart, and conduct a detailed analysis using mutual information theory. We augment the FLAN dataset by constructing paired prompts, each consisting of a clean prompt and its corresponding noisy version for training. Additionally, to evaluate the effectiveness, we develop NoisyPromptBench, a benchmark enhanced and derived from the existing PromptBench. Experimental results conducted on NoisyPromptBench demonstrate that our proposed method achieves a significant improvement in average accuracy over the current state-of-the-art approaches. The source code of CoIPO, pair-wise FLAN datasets, and NoisyPromptBench have already been released on https://github.com/vegetable-yx/CoIPO.","url_abs":"https://arxiv.org/abs/2603.03314","url_pdf":"https://arxiv.org/pdf/2603.03314","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.03314","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.03314"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/vegetable-yx/CoIPO","reach":null}],"summary":{"ran":1,"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"found_in_text":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"d9cf256672b2d843","entry":"ContrastiveLoss","repo":"vegetable-yx/CoIPO","repo_kind":"found_in_text","path":"ContrastiveLlama.py","file_url":"https://github.com/vegetable-yx/CoIPO/blob/HEAD/ContrastiveLlama.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d9cf256672b2d843"}},{"code_sha256_prefix":"56739640fa432aa6","entry":"separate_batch_prompts","repo":"vegetable-yx/CoIPO","repo_kind":"found_in_text","path":"ContrastiveLlama.py","file_url":"https://github.com/vegetable-yx/CoIPO/blob/HEAD/ContrastiveLlama.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"56739640fa432aa6"}},{"code_sha256_prefix":"e449146d4745cc0c","entry":"ContrastiveEvalOutput","repo":"vegetable-yx/CoIPO","repo_kind":"found_in_text","path":"ContrastiveLlama.py","file_url":"https://github.com/vegetable-yx/CoIPO/blob/HEAD/ContrastiveLlama.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e449146d4745cc0c"}},{"code_sha256_prefix":"043084a51b2808ae","entry":"ContrastiveLlama","repo":"vegetable-yx/CoIPO","repo_kind":"found_in_text","path":"ContrastiveLlama.py","file_url":"https://github.com/vegetable-yx/CoIPO/blob/HEAD/ContrastiveLlama.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"043084a51b2808ae"}},{"code_sha256_prefix":"a7306c4b87c799f9","entry":"ContrastiveLlamaOutput","repo":"vegetable-yx/CoIPO","repo_kind":"found_in_text","path":"ContrastiveLlama.py","file_url":"https://github.com/vegetable-yx/CoIPO/blob/HEAD/ContrastiveLlama.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a7306c4b87c799f9"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}