{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/read-attend-and-code-pushing-the-limits-of","title":"Read, Attend, and Code: Pushing the Limits of Medical Codes Prediction from Clinical Notes by Machines","arxiv_id":"2107.10650","date":"2021-07-10","proceeding":null,"authors":["Byung-Hak Kim","Varun Ganapathi"],"abstract":"Prediction of medical codes from clinical notes is both a practical and essential need for every healthcare delivery organization within current medical systems. Automating annotation will save significant time and excessive effort spent by human coders today. However, the biggest challenge is directly identifying appropriate medical codes out of several thousands of high-dimensional codes from unstructured free-text clinical notes. In the past three years, with Convolutional Neural Networks (CNN) and Long Short-Term Memory (LTSM) networks, there have been vast improvements in tackling the most challenging benchmark of the MIMIC-III-full-label inpatient clinical notes dataset. This progress raises the fundamental question of how far automated machine learning (ML) systems are from human coders' working performance. We assessed the baseline of human coders' performance on the same subsampled testing set. We also present our Read, Attend, and Code (RAC) model for learning the medical code assignment mappings. By connecting convolved embeddings with self-attention and code-title guided attention modules, combined with sentence permutation-based data augmentations and stochastic weight averaging training, RAC establishes a new state of the art (SOTA), considerably outperforming the current best Macro-F1 by 18.7%, and reaches past the human-level coding baseline. This new milestone marks a meaningful step toward fully autonomous medical coding (AMC) in machines reaching parity with human coders' performance in medical code prediction.","url_abs":"https://arxiv.org/abs/2107.10650v1","url_pdf":"https://arxiv.org/pdf/2107.10650v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"medical-code-prediction","task_name":"Medical Code Prediction"},{"task_slug":"multi-label-classification-of-biomedical","task_name":"Multi-Label Classification Of Biomedical Texts"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[{"method_slug":"1d-cnn","method_name":"1D CNN"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"stochastic-weight-averaging","method_name":"Stochastic Weight Averaging"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/medical-code-prediction-on-mimic-iii","task":"Medical Code Prediction","dataset":"MIMIC-III","model":"RAC","rank_in_archive_order":6,"of":18,"metrics":{"Macro-AUC":"94.8","Macro-F1":"12.7","Micro-AUC":"99.2","Micro-F1":"58.6","Precision@15":"60.1","Precision@5":"82.9","Precision@8":"75.4"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2107.10650","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}