{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/we-should-at-least-be-able-to-design","title":"We Should at Least Be Able to Design Molecules That Dock Well","arxiv_id":"2006.16955","date":"2020-06-20","proceeding":null,"authors":["Tobiasz Cieplinski","Tomasz Danel","Sabina Podlewska","Stanislaw Jastrzebski"],"abstract":"Designing compounds with desired properties is a key element of the drug discovery process. However, measuring progress in the field has been challenging due to the lack of realistic retrospective benchmarks, and the large cost of prospective validation. To close this gap, we propose a benchmark based on docking, a popular computational method for assessing molecule binding to a protein. Concretely, the goal is to generate drug-like molecules that are scored highly by SMINA, a popular docking software. We observe that popular graph-based generative models fail to generate molecules with a high docking score when trained using a realistically sized training set. This suggests a limitation of the current incarnation of models for de novo drug design. Finally, we propose a simplified version of the benchmark based on a simpler scoring function, and show that the tested models are able to partially solve it. We release the benchmark as an easy to use package available at https://github.com/cieplinski-tobiasz/smina-docking-benchmark. We hope that our benchmark will serve as a stepping stone towards the goal of automatically generating promising drug candidates.","url_abs":"https://arxiv.org/abs/2006.16955v5","url_pdf":"https://arxiv.org/pdf/2006.16955v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"we-should-at-least-be-able-to-design","repo_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"drug-design","task_name":"Drug Design"},{"task_slug":"drug-discovery","task_name":"Drug Discovery"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2006.16955","atlas_url":"https://app.syntology.ai/?focus=2006.16955","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.16955"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":9},"by_repo_kind":{"official":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"47b5c85dc742bb70","entry":"create_two_layer_mlp","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_baselines/models/predicted_docking_functions.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_baselines/models/predicted_docking_functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"47b5c85dc742bb70"}},{"code_sha256_prefix":"3141ad94179b3715","entry":"filter_valid_length","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_baselines/models/cvae/mol_utils.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_baselines/models/cvae/mol_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3141ad94179b3715"}},{"code_sha256_prefix":"14baf018aacc23d8","entry":"filter_valid_smiles_return_invalid","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_baselines/models/cvae/mol_utils.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_baselines/models/cvae/mol_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"14baf018aacc23d8"}},{"code_sha256_prefix":"0e34a9b6b988b6c9","entry":"min_aggregator","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_benchmark/docking/smina/docking.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_benchmark/docking/smina/docking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0e34a9b6b988b6c9"}},{"code_sha256_prefix":"9d6142fd1c0fbd37","entry":"pad_smile","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_baselines/models/cvae/mol_utils.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_baselines/models/cvae/mol_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9d6142fd1c0fbd37"}},{"code_sha256_prefix":"6a3e5e75563de42b","entry":"parse_docking_score","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_benchmark/docking/smina/parsing.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_benchmark/docking/smina/parsing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a3e5e75563de42b"}},{"code_sha256_prefix":"0468e0138c1efb4c","entry":"parse_score_only","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_benchmark/docking/smina/parsing.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_benchmark/docking/smina/parsing.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0468e0138c1efb4c"}},{"code_sha256_prefix":"9692d14f76b386be","entry":"setup_and_get_logger","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_benchmark/utils/logging.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_benchmark/utils/logging.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9692d14f76b386be"}},{"code_sha256_prefix":"959c813b24ad939d","entry":"top_n_aggregator","repo":"cieplinski-tobiasz/smina-docking-benchmark","repo_kind":"official","path":"docking_benchmark/docking/smina/docking.py","file_url":"https://github.com/cieplinski-tobiasz/smina-docking-benchmark/blob/HEAD/docking_benchmark/docking/smina/docking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"959c813b24ad939d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}