{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/curriculum-learning-for-biological-sequence","title":"Curriculum Learning for Biological Sequence Prediction: The Case of De Novo Peptide Sequencing","arxiv_id":"2506.13485","date":"2025-06-16","proceeding":null,"authors":["Xiang Zhang","Jiaqi Wei","Zijie Qiu","Sheng Xu","Nanqing Dong","Zhiqiang Gao","Siqi Sun"],"abstract":"Peptide sequencing-the process of identifying amino acid sequences from mass spectrometry data-is a fundamental task in proteomics. Non-Autoregressive Transformers (NATs) have proven highly effective for this task, outperforming traditional methods. Unlike autoregressive models, which generate tokens sequentially, NATs predict all positions simultaneously, leveraging bidirectional context through unmasked self-attention. However, existing NAT approaches often rely on Connectionist Temporal Classification (CTC) loss, which presents significant optimization challenges due to CTC's complexity and increases the risk of training failures. To address these issues, we propose an improved non-autoregressive peptide sequencing model that incorporates a structured protein sequence curriculum learning strategy. This approach adjusts protein's learning difficulty based on the model's estimated protein generational capabilities through a sampling process, progressively learning peptide generation from simple to complex sequences. Additionally, we introduce a self-refining inference-time module that iteratively enhances predictions using learned NAT token embeddings, improving sequence accuracy at a fine-grained level. Our curriculum learning strategy reduces NAT training failures frequency by more than 90% based on sampled training over various data distributions. Evaluations on nine benchmark species demonstrate that our approach outperforms all previous methods across multiple metrics and species.","url_abs":"https://arxiv.org/abs/2506.13485v1","url_pdf":"https://arxiv.org/pdf/2506.13485v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"curriculum-learning-for-biological-sequence","repo_url":"https://github.com/beam-labs/denovo","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"de-novo-peptide-sequencing","task_name":"de novo peptide sequencing"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2506.13485","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2506.13485"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/beam-labs/denovo","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"876ac8be586df96a","entry":"ctc_post_processing","repo":"beam-labs/denovo","repo_kind":"official","path":"PrimeNovo/denovo/model.py","file_url":"https://github.com/beam-labs/denovo/blob/HEAD/PrimeNovo/denovo/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"876ac8be586df96a"}},{"code_sha256_prefix":"145ed062058f289a","entry":"listify","repo":"beam-labs/denovo","repo_kind":"official","path":"ContraNovo/denovo/db_index.py","file_url":"https://github.com/beam-labs/denovo/blob/HEAD/ContraNovo/denovo/db_index.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"145ed062058f289a"}},{"code_sha256_prefix":"31a373bc695fdaac","entry":"mass_cal","repo":"beam-labs/denovo","repo_kind":"official","path":"PrimeNovo/denovo/model.py","file_url":"https://github.com/beam-labs/denovo/blob/HEAD/PrimeNovo/denovo/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"31a373bc695fdaac"}},{"code_sha256_prefix":"e21ac907bcfd2287","entry":"prepare_batch","repo":"beam-labs/denovo","repo_kind":"official","path":"ContraNovo/denovo/dataloaders.py","file_url":"https://github.com/beam-labs/denovo/blob/HEAD/ContraNovo/denovo/dataloaders.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e21ac907bcfd2287"}},{"code_sha256_prefix":"a87eb9bcb3fae642","entry":"remove_repentance","repo":"beam-labs/denovo","repo_kind":"official","path":"PrimeNovo/denovo/model.py","file_url":"https://github.com/beam-labs/denovo/blob/HEAD/PrimeNovo/denovo/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a87eb9bcb3fae642"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}