{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/apollo-an-optimized-training-approach-for","title":"APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning","arxiv_id":"2212.07249","date":"2022-12-14","proceeding":null,"authors":["Jiashuo Sun","Hang Zhang","Chen Lin","Xiangdong Su","Yeyun Gong","Jian Guo"],"abstract":"Long-form numerical reasoning in financial analysis aims to generate a reasoning program to calculate the correct answer for a given question. Previous work followed a retriever-generator framework, where the retriever selects key facts from a long-form document, and the generator generates a reasoning program based on retrieved facts. However, they treated all facts equally without considering the different contributions of facts with and without numbers. Meanwhile, the program consistency were ignored under supervised training, resulting in lower training accuracy and diversity. To solve these problems, we proposed APOLLO to improve the long-form numerical reasoning framework. For the retriever, we adopt a number-aware negative sampling strategy to enable the retriever to be more discriminative on key numerical facts. For the generator, we design consistency-based reinforcement learning and target program augmentation strategy based on the consistency of program execution results. Experimental results on the FinQA and ConvFinQA leaderboard verify the effectiveness of our proposed method, achieving the new state-of-the-art.","url_abs":"https://arxiv.org/abs/2212.07249v3","url_pdf":"https://arxiv.org/pdf/2212.07249v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"apollo-an-optimized-training-approach-for","repo_url":"https://github.com/gasolsun36/apollo","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"apollo-an-optimized-training-approach-for","repo_url":"https://github.com/gasolsun36/dynamicrag","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"apollo-an-optimized-training-approach-for","repo_url":"https://github.com/gasolsun36/iter-cot","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"conversational-question-answering","task_name":"Conversational Question Answering"},{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"financial-analysis","task_name":"Financial Analysis"},{"task_slug":"form","task_name":"Form"},{"task_slug":"question-answering","task_name":"Question Answering"}],"methods":[{"method_slug":"apollo","method_name":"Apollo"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/conversational-question-answering-on","task":"Conversational Question Answering","dataset":"ConvFinQA","model":"APOLLO","rank_in_archive_order":1,"of":2,"metrics":{"Execution Accuracy":"78.76","Program Accuracy":"77.19"},"uses_additional_data":false},{"leaderboard":"/sota/question-answering-on-finqa","task":"Question Answering","dataset":"FinQA","model":"APOLLO","rank_in_archive_order":1,"of":6,"metrics":{"Execution Accuracy":"71.07","Program Accuracy":"68.94"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2212.07249","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}