{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adaptive-transformer-modelling-of-density","title":"Adaptive Transformer Modelling of Density Function for Nonparametric Survival Analysis","arxiv_id":"2409.06209","date":"2024-09-10","proceeding":null,"authors":["Xin Zhang","Deval Mehta","Yanan Hu","Chao Zhu","David Darby","Zhen Yu","Daniel Merlo","Melissa Gresle","Anneke Van Der Walt","Helmut Butzkueven","ZongYuan Ge"],"abstract":"Survival analysis holds a crucial role across diverse disciplines, such as economics, engineering and healthcare. It empowers researchers to analyze both time-invariant and time-varying data, encompassing phenomena like customer churn, material degradation and various medical outcomes. Given the complexity and heterogeneity of such data, recent endeavors have demonstrated successful integration of deep learning methodologies to address limitations in conventional statistical approaches. However, current methods typically involve cluttered probability distribution function (PDF), have lower sensitivity in censoring prediction, only model static datasets, or only rely on recurrent neural networks for dynamic modelling. In this paper, we propose a novel survival regression method capable of producing high-quality unimodal PDFs without any prior distribution assumption, by optimizing novel Margin-Mean-Variance loss and leveraging the flexibility of Transformer to handle both temporal and non-temporal data, coined UniSurv. Extensive experiments on several datasets demonstrate that UniSurv places a significantly higher emphasis on censoring compared to other methods.","url_abs":"https://arxiv.org/abs/2409.06209v1","url_pdf":"https://arxiv.org/pdf/2409.06209v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adaptive-transformer-modelling-of-density","repo_url":"https://github.com/xinz0419/unisurv","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"survival-analysis","task_name":"Survival Analysis"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.06209","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.06209"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xinz0419/unisurv","reach":{"status":"ok"}}],"summary":{"ran":5,"ran_draft_wrong":2,"ran_honours":1},"by_repo_kind":{"official":{"samples":8,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"498679fc2a526ad5","entry":"KMLinearExt","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/mae_margin.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/mae_margin.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"498679fc2a526ad5"}},{"code_sha256_prefix":"916dd244b4ead0ac","entry":"attention","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/MultiHeadedAttention.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/MultiHeadedAttention.py","link_basis":"plan_row","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"916dd244b4ead0ac"}},{"code_sha256_prefix":"a3722169bbc81569","entry":"clones","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/utils.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a3722169bbc81569"}},{"code_sha256_prefix":"f6b944f50d3f15ae","entry":"count_parameters","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/utils.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/utils.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f6b944f50d3f15ae"}},{"code_sha256_prefix":"55e2671f9d3baf28","entry":"find_maxmin","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/image_generation.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/image_generation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"55e2671f9d3baf28"}},{"code_sha256_prefix":"ce9d00343210718b","entry":"minmax_norm","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/image_generation.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/image_generation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ce9d00343210718b"}},{"code_sha256_prefix":"90dc459c367d1bcd","entry":"parse_args_gs","repo":"xinz0419/unisurv","repo_kind":"official","path":"main_GridSearch.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/main_GridSearch.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"90dc459c367d1bcd"}},{"code_sha256_prefix":"27cadc39dee0bb08","entry":"patient_extr","repo":"xinz0419/unisurv","repo_kind":"official","path":"modules/image_generation.py","file_url":"https://github.com/xinz0419/unisurv/blob/HEAD/modules/image_generation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"27cadc39dee0bb08"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}