{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/numerical-claim-detection-in-finance-a-new","title":"Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis","arxiv_id":"2402.11728","date":"2024-02-18","proceeding":null,"authors":["Agam Shah","Arnav Hiray","Pratvi Shah","Arkaprabha Banerjee","Anushka Singh","Dheeraj Eidnani","Sahasra Chava","Bhaskar Chaudhury","Sudheer Chava"],"abstract":"In this paper, we investigate the influence of claims in analyst reports and earnings calls on financial market returns, considering them as significant quarterly events for publicly traded companies. To facilitate a comprehensive analysis, we construct a new financial dataset for the claim detection task in the financial domain. We benchmark various language models on this dataset and propose a novel weak-supervision model that incorporates the knowledge of subject matter experts (SMEs) in the aggregation function, outperforming existing approaches. We also demonstrate the practical utility of our proposed model by constructing a novel measure of optimism. Here, we observe the dependence of earnings surprise and return on our optimism measure. Our dataset, models, and code are publicly (under CC BY 4.0 license) available on GitHub.","url_abs":"https://arxiv.org/abs/2402.11728v2","url_pdf":"https://arxiv.org/pdf/2402.11728v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"numerical-claim-detection-in-finance-a-new","repo_url":"https://github.com/gtfintechlab/fin-num-claim","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2402.11728","atlas_url":"https://app.syntology.ai/?focus=2402.11728","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.11728"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gtfintechlab/fin-num-claim","reach":null}],"summary":{"ran_violates":1,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"5430f2e5f4ede39f","entry":"check_for_numeric_data","repo":"gtfintechlab/fin-num-claim","repo_kind":"official","path":"code/WS_model.py","file_url":"https://github.com/gtfintechlab/fin-num-claim/blob/HEAD/code/WS_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5430f2e5f4ede39f"}},{"code_sha256_prefix":"9a2f7841367ae5ee","entry":"split_into_sentences","repo":"gtfintechlab/fin-num-claim","repo_kind":"official","path":"code/WS_model.py","file_url":"https://github.com/gtfintechlab/fin-num-claim/blob/HEAD/code/WS_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"9a2f7841367ae5ee"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}