{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/passing-the-brazilian-oab-exam-data","title":"Passing the Brazilian OAB Exam: data preparation and some experiments","arxiv_id":"1712.05128","date":"2017-12-14","proceeding":null,"authors":["Pedro Delfino","Bruno Cuconato","Edward Hermann Haeusler","Alexandre Rademaker"],"abstract":"In Brazil, all legal professionals must demonstrate their knowledge of the\nlaw and its application by passing the OAB exams, the national bar exams. The\nOAB exams therefore provide an excellent benchmark for the performance of legal\ninformation systems since passing the exam would arguably signal that the\nsystem has acquired capacity of legal reasoning comparable to that of a human\nlawyer. This article describes the construction of a new data set and some\npreliminary experiments on it, treating the problem of finding the\njustification for the answers to questions. The results provide a baseline\nperformance measure against which to evaluate future improvements. We discuss\nthe reasons to the poor performance and propose next steps.","url_abs":"http://arxiv.org/abs/1712.05128v1","url_pdf":"http://arxiv.org/pdf/1712.05128v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"passing-the-brazilian-oab-exam-data","repo_url":"https://github.com/own-pt/oab-exams","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"legal-reasoning","task_name":"Legal Reasoning"}],"methods":[],"datasets_introduced":[{"slug":"oab-exams","name":"OAB Exams","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}