{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-20019","title":"Multi-Objective Reinforcement Learning for Generating Covalent Inhibitor Candidates","arxiv_id":"2604.20019","date":"2026-04-21","proceeding":null,"authors":["Renee Gil"],"abstract":"Rational design of covalent inhibitors requires simultaneously optimizing multiple properties, such as binding affinity, target selectivity, or electrophilic reactivity. This presents a multi-objective problem not easily addressed by screening alone. Here we present a machine learning pipeline for generating covalent inhibitor candidates using multi-objective reinforcement learning (RL), applied to two targets: epidermal growth factor receptor (EGFR) and acetylcholinesterase (ACHE). A SMILES-based pretrained LSTM serves as the generative model, optimized via policy gradient RL with Pareto crowding distance to balance competing scoring functions including synthetic accessibility, predicted covalent activity, residue affinity, and an approximated docking score. The pipeline rediscovers known covalent inhibitors at rates of up to 0.50% (EGFR) and 0.74% (ACHE) in 10,000-structure runs, with candidate structures achieving warhead-to-residue distances as short as 5.5 angstrom (EGFR) and 3.2 angstrom (ACHE) after further docking-based screening. More notably, the pipeline spontaneously generates structures bearing warhead motifs absent from the training data - including allenes, 3-oxo-$β$-sultams, and $α$-methylene-$β$-lactones - all of which have independent literature support as covalent warheads. These results suggest that RL-guided generation can explore covalent chemical space beyond its training distribution, and may be useful as a tool for medicinal chemists working on covalent drug discovery.","url_abs":"https://arxiv.org/abs/2604.20019","url_pdf":"https://arxiv.org/pdf/2604.20019","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2604.20019","atlas_url":"https://app.syntology.ai/?focus=2604.20019","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.20019"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/CDDLeiden/DrugEx","reach":null}],"summary":{"ran":3,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":5,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"704870bb2ed93373","entry":"generateBackupDir","repo":"CDDLeiden/DrugEx","repo_kind":"found_in_text","path":"drugex/logs/utils.py","file_url":"https://github.com/CDDLeiden/DrugEx/blob/HEAD/drugex/logs/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"704870bb2ed93373"}},{"code_sha256_prefix":"b75d75d7ed3fc51f","entry":"generate_backup_runID","repo":"CDDLeiden/DrugEx","repo_kind":"found_in_text","path":"drugex/logs/utils.py","file_url":"https://github.com/CDDLeiden/DrugEx/blob/HEAD/drugex/logs/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b75d75d7ed3fc51f"}},{"code_sha256_prefix":"6d7e5debe19798a5","entry":"get_runid","repo":"CDDLeiden/DrugEx","repo_kind":"found_in_text","path":"drugex/logs/config.py","file_url":"https://github.com/CDDLeiden/DrugEx/blob/HEAD/drugex/logs/config.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6d7e5debe19798a5"}},{"code_sha256_prefix":"3b0f039a28497900","entry":"DesignArgParser","repo":"CDDLeiden/DrugEx","repo_kind":"found_in_text","path":"drugex/generate.py","file_url":"https://github.com/CDDLeiden/DrugEx/blob/HEAD/drugex/generate.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b0f039a28497900"}},{"code_sha256_prefix":"05a8833aaa4bdb6e","entry":"load_molecules","repo":"CDDLeiden/DrugEx","repo_kind":"found_in_text","path":"drugex/dataset.py","file_url":"https://github.com/CDDLeiden/DrugEx/blob/HEAD/drugex/dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05a8833aaa4bdb6e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}