{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-03294","title":"Fine-Tuning and Evaluating Conversational AI for Agricultural Advisory","arxiv_id":"2603.03294","date":"2026-02-06","proceeding":null,"authors":["Sanyam Singh","Naga Ganesh","Vineet Singh","Lakshmi Pedapudi","Ritesh Kumar","SSP Jyothi","Archana Karanam","Waseem Pasha","Ekta Kumari","C. Yashoda","Mettu Vijaya Rekha Reddy","Shesha Phani Debbesa","Chandan Dash"],"abstract":"Large Language Models show promise for agricultural advisory, yet vanilla models exhibit unsupported recommendations, generic advice lacking specific, actionable detail, and communication styles misaligned with smallholder farmer needs. In high stakes agricultural contexts, where recommendation accuracy has direct consequences for farmer outcomes, these limitations pose challenges for responsible deployment. We present a hybrid LLM architecture that decouples factual retrieval from conversational delivery: supervised fine-tuning with LoRA on expert-curated GOLDEN FACTS (atomic, verified units of agricultural knowledge) optimizes fact recall, while a separate stitching layer transforms retrieved facts into culturally appropriate, safety-aware responses. Our evaluation framework, DG-EVAL, performs atomic fact verification (measuring recall, precision, and contradiction detection) against expert-curated ground truth rather than Wikipedia or retrieved documents. Experiments across multiple model configurations on crops and queries from Bihar, India show that fine-tuning on curated data substantially improves fact recall and F1, while maintaining high relevance. Using a fine-tuned smaller model achieves comparable or better factual quality at a fraction of the cost of frontier models. A stitching layer further improves safety subscores while maintaining high conversational quality. We release the farmerchat-prompts library to enable reproducible development of domain-specific agricultural AI.","url_abs":"https://arxiv.org/abs/2603.03294","url_pdf":"https://arxiv.org/pdf/2603.03294","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2603.03294","atlas_url":"https://app.syntology.ai/?focus=2603.03294","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.03294"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/digitalgreenorg/farmerchat-prompts","reach":null}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4f0bdc8931447533","entry":"PromptManager","repo":"digitalgreenorg/farmerchat-prompts","repo_kind":"found_in_text","path":"farmerchat_prompts/manager.py","file_url":"https://github.com/digitalgreenorg/farmerchat-prompts/blob/HEAD/farmerchat_prompts/manager.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4f0bdc8931447533"}},{"code_sha256_prefix":"3926c1be38a07175","entry":"PromptMetadata","repo":"digitalgreenorg/farmerchat-prompts","repo_kind":"found_in_text","path":"farmerchat_prompts/manager.py","file_url":"https://github.com/digitalgreenorg/farmerchat-prompts/blob/HEAD/farmerchat_prompts/manager.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3926c1be38a07175"}},{"code_sha256_prefix":"4950c645f6d14971","entry":"Domain","repo":"digitalgreenorg/farmerchat-prompts","repo_kind":"found_in_text","path":"farmerchat_prompts/manager.py","file_url":"https://github.com/digitalgreenorg/farmerchat-prompts/blob/HEAD/farmerchat_prompts/manager.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4950c645f6d14971"}},{"code_sha256_prefix":"6801332cf30abc50","entry":"Prompt","repo":"digitalgreenorg/farmerchat-prompts","repo_kind":"found_in_text","path":"farmerchat_prompts/manager.py","file_url":"https://github.com/digitalgreenorg/farmerchat-prompts/blob/HEAD/farmerchat_prompts/manager.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6801332cf30abc50"}},{"code_sha256_prefix":"890b7e1878557004","entry":"Provider","repo":"digitalgreenorg/farmerchat-prompts","repo_kind":"found_in_text","path":"farmerchat_prompts/manager.py","file_url":"https://github.com/digitalgreenorg/farmerchat-prompts/blob/HEAD/farmerchat_prompts/manager.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"890b7e1878557004"}},{"code_sha256_prefix":"0abba9e44e9a8cb8","entry":"UseCase","repo":"digitalgreenorg/farmerchat-prompts","repo_kind":"found_in_text","path":"farmerchat_prompts/manager.py","file_url":"https://github.com/digitalgreenorg/farmerchat-prompts/blob/HEAD/farmerchat_prompts/manager.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0abba9e44e9a8cb8"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}