{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2509-24496","title":"LLM DNA: Tracing Model Evolution via Functional Representations","arxiv_id":"2509.24496","date":"2025-09-29","proceeding":"ICLR","authors":["Zhaomin Wu","Haodong Zhao","Ziyang Wang","Jizhou Guo","Qian Wang","Bingsheng He"],"abstract":"The explosive growth of large language models (LLMs) has created a vast but opaque landscape: millions of models exist, yet their evolutionary relationships through fine-tuning, distillation, or adaptation are often undocumented or unclear, complicating LLM management. Existing methods are limited by task specificity, fixed model sets, or strict assumptions about tokenizers or architectures. Inspired by biological DNA, we address these limitations by mathematically defining LLM DNA as a low-dimensional, bi-Lipschitz representation of functional behavior. We prove that LLM DNA satisfies inheritance and genetic determinism properties and establish the existence of DNA. Building on this theory, we derive a general, scalable, training-free pipeline for DNA extraction. In experiments across 305 LLMs, DNA aligns with prior studies on limited subsets and achieves superior or competitive performance on specific tasks. Beyond these tasks, DNA comparisons uncover previously undocumented relationships among LLMs. We further construct the evolutionary tree of LLMs using phylogenetic algorithms, which align with shifts from encoder-decoder to decoder-only architectures, reflect temporal progression, and reveal distinct evolutionary speeds across LLM families.","url_abs":"https://arxiv.org/abs/2509.24496","url_pdf":"https://arxiv.org/pdf/2509.24496","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2509.24496","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2509.24496"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/Xtra-Computing/LLM-DNA","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":11},"by_repo_kind":{"found_in_text":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"02f6727089f3b19b","entry":"derive_default_output_path","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/models/get_model_metadata.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/models/get_model_metadata.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"02f6727089f3b19b"}},{"code_sha256_prefix":"773dbb73838dc4ea","entry":"fetch_model_metadata","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/utils/metadata.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/utils/metadata.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"773dbb73838dc4ea"}},{"code_sha256_prefix":"186043b0bc0c9369","entry":"get_cache_dir","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/utils/DataUtils.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/utils/DataUtils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"186043b0bc0c9369"}},{"code_sha256_prefix":"0567724e583de370","entry":"get_dataset_name","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/core/extraction.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/core/extraction.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0567724e583de370"}},{"code_sha256_prefix":"c9bec588fe4b097f","entry":"get_model_metadata","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/utils/metadata.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/utils/metadata.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c9bec588fe4b097f"}},{"code_sha256_prefix":"9dd098bc96d74f94","entry":"is_chat_model","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/utils/check_chat_model.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/utils/check_chat_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9dd098bc96d74f94"}},{"code_sha256_prefix":"808e6a8a198ccd32","entry":"load_config","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/utils/DataUtils.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/utils/DataUtils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"808e6a8a198ccd32"}},{"code_sha256_prefix":"4f5daa5f5ff24245","entry":"load_model_list","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/models/get_model_metadata.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/models/get_model_metadata.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4f5daa5f5ff24245"}},{"code_sha256_prefix":"ba9008e126dd9906","entry":"load_model_metadata","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/core/extraction.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/core/extraction.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ba9008e126dd9906"}},{"code_sha256_prefix":"f67940d46925b905","entry":"load_results","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/utils/DataUtils.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/utils/DataUtils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f67940d46925b905"}},{"code_sha256_prefix":"f4f4d45a29673b77","entry":"parse_arguments","repo":"Xtra-Computing/LLM-DNA","repo_kind":"found_in_text","path":"src/llm_dna/core/extraction.py","file_url":"https://github.com/Xtra-Computing/LLM-DNA/blob/HEAD/src/llm_dna/core/extraction.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f4f4d45a29673b77"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_api"},"syntology_extracted_results":null}