{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/automated-review-generation-method-based-on","title":"Automated Review Generation Method Based on Large Language Models","arxiv_id":"2407.20906","date":"2024-07-30","proceeding":null,"authors":["Shican Wu","Xiao Ma","Dehui Luo","Lulu Li","Xiangcheng Shi","Xin Chang","Xiaoyun Lin","Ran Luo","Chunlei Pei","Changying Du","Zhi-Jian Zhao","Jinlong Gong"],"abstract":"Literature research, vital for scientific work, faces the challenge of surging information volumes exceeding researchers' processing capabilities. We present an automated review generation method based on large language models (LLMs) to overcome efficiency bottlenecks and reduce cognitive load. Our statistically validated evaluation framework demonstrates that the generated reviews match or exceed manual quality, offering broad applicability across research fields without requiring users' domain knowledge. Applied to propane dehydrogenation (PDH) catalysts, our method swiftly analyzed 343 articles, averaging seconds per article per LLM account, producing comprehensive reviews spanning 35 topics, with extended analysis of 1041 articles providing insights into catalysts' properties. Through multi-layered quality control, we effectively mitigated LLMs' hallucinations, with expert verification confirming accuracy and citation integrity while demonstrating hallucination risks reduced to below 0.5\\% with 95\\% confidence. Released Windows application enables one-click review generation, enhancing research productivity and literature recommendation efficiency while setting the stage for broader scientific explorations.","url_abs":"https://arxiv.org/abs/2407.20906v5","url_pdf":"https://arxiv.org/pdf/2407.20906v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"automated-review-generation-method-based-on","repo_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"articles","task_name":"Articles"},{"task_slug":"hallucination","task_name":"Hallucination"},{"task_slug":"review-generation","task_name":"Review Generation"}],"methods":[],"datasets_introduced":[{"slug":"all-intermediate-data-for-automatic-review","name":"All intermediate data for Automatic Review Generation","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2407.20906","atlas_url":"https://app.syntology.ai/?focus=2407.20906","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.20906"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/tju-ecat-ai/automaticreviewgeneration","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":10,"unverified":2},"by_repo_kind":{"official":{"samples":12,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"353f992ada2aa64b","entry":"GetResult","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/MainContributeCatalystDetailStatisticsNew.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/MainContributeCatalystDetailStatisticsNew.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"353f992ada2aa64b"}},{"code_sha256_prefix":"090c0e4832fe5b1a","entry":"calculate_linewidths","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/BubblePlotAll.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/BubblePlotAll.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"090c0e4832fe5b1a"}},{"code_sha256_prefix":"ffa6d186e0b4fc1f","entry":"calculate_relative_score_diff","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"QualityEvaluation/ComparedScore.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/QualityEvaluation/ComparedScore.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ffa6d186e0b4fc1f"}},{"code_sha256_prefix":"1e0efb58887cbed2","entry":"calculate_yearly_frequency","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/PlotGanttTypeAll.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/PlotGanttTypeAll.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1e0efb58887cbed2"}},{"code_sha256_prefix":"5d086858b4ba9be5","entry":"create_analysis_df","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"ReviewComposition/Advanced_ComparedScore.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/ReviewComposition/Advanced_ComparedScore.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5d086858b4ba9be5"}},{"code_sha256_prefix":"2bb840a90716d658","entry":"extract_element","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/AveragedTop5.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/AveragedTop5.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2bb840a90716d658"}},{"code_sha256_prefix":"e525116fe4648434","entry":"get_text","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/MainContributeCatalystDetailStatisticsNew.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/MainContributeCatalystDetailStatisticsNew.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e525116fe4648434"}},{"code_sha256_prefix":"2ba37728ec3e26a8","entry":"outliers_iqr","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/BubblePlotAll.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/BubblePlotAll.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2ba37728ec3e26a8"}},{"code_sha256_prefix":"6f352bd68526a5d4","entry":"process_json","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"ReviewComposition/Advanced_ComparedScore.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/ReviewComposition/Advanced_ComparedScore.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6f352bd68526a5d4"}},{"code_sha256_prefix":"615041a63880f3f5","entry":"truncate_at_first_digit","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/MainContributeCatalystDetailStatisticsNew.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/MainContributeCatalystDetailStatisticsNew.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"615041a63880f3f5"}},{"code_sha256_prefix":"468592d930975a2b","entry":"GetResponseFromClaudeViaWebAgent","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"DataMining/AnswerIntegration.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/DataMining/AnswerIntegration.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"468592d930975a2b"}},{"code_sha256_prefix":"8f9db599f9f467a3","entry":"process_file","repo":"tju-ecat-ai/automaticreviewgeneration","repo_kind":"official","path":"ReviewComposition/Advanced_ComparedScore.py","file_url":"https://github.com/tju-ecat-ai/automaticreviewgeneration/blob/HEAD/ReviewComposition/Advanced_ComparedScore.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8f9db599f9f467a3"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}