{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/exploring-model-transferability-through-the","title":"Exploring Model Transferability through the Lens of Potential Energy","arxiv_id":"2308.15074","date":"2023-08-29","proceeding":"ICCV 2023 1","authors":["Xiaotong Li","Zixuan Hu","Yixiao Ge","Ying Shan","Ling-Yu Duan"],"abstract":"Transfer learning has become crucial in computer vision tasks due to the vast availability of pre-trained deep learning models. However, selecting the optimal pre-trained model from a diverse pool for a specific downstream task remains a challenge. Existing methods for measuring the transferability of pre-trained models rely on statistical correlations between encoded static features and task labels, but they overlook the impact of underlying representation dynamics during fine-tuning, leading to unreliable results, especially for self-supervised models. In this paper, we present an insightful physics-inspired approach named PED to address these challenges. We reframe the challenge of model selection through the lens of potential energy and directly model the interaction forces that influence fine-tuning dynamics. By capturing the motion of dynamic representations to decline the potential energy within a force-driven physical model, we can acquire an enhanced and more stable observation for estimating transferability. The experimental results on 10 downstream tasks and 12 self-supervised models demonstrate that our approach can seamlessly integrate into existing ranking techniques and enhance their performances, revealing its effectiveness for the model selection task and its potential for understanding the mechanism in transfer learning. Code will be available at https://github.com/lixiaotong97/PED.","url_abs":"https://arxiv.org/abs/2308.15074v1","url_pdf":"https://arxiv.org/pdf/2308.15074v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"exploring-model-transferability-through-the","repo_url":"https://github.com/lixiaotong97/ped","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"model-selection","task_name":"Model Selection"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.15074","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.15074"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lixiaotong97/ped","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/lixiaotong97/PED","reach":{"status":"ok"}}],"summary":{"ran":10,"ran_fixture":5,"ran_violates":2,"ran_honours":1,"unverified":6},"by_repo_kind":{"official":{"samples":24,"ran":18,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":24,"samples":[{"code_sha256_prefix":"36b80c8ca396f40f","entry":"NLEEP","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"36b80c8ca396f40f"}},{"code_sha256_prefix":"e4c01fe7d32a8910","entry":"One_Step_PED","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e4c01fe7d32a8910"}},{"code_sha256_prefix":"f6bfd5e75d967738","entry":"SFDA_Score","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f6bfd5e75d967738"}},{"code_sha256_prefix":"05e6e5526351f2e5","entry":"_class_means","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"05e6e5526351f2e5"}},{"code_sha256_prefix":"253f73c24f659608","entry":"compute_per_class_mean_variance_num","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"253f73c24f659608"}},{"code_sha256_prefix":"e628a3f24dbdf568","entry":"count_acc","repo":"lixiaotong97/ped","repo_kind":"official","path":"finetune.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/finetune.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e628a3f24dbdf568"}},{"code_sha256_prefix":"18ca56bb62e92fc5","entry":"exist_score","repo":"lixiaotong97/ped","repo_kind":"official","path":"evaluate_metric_cpu.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/evaluate_metric_cpu.py","link_basis":"plan_row","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"18ca56bb62e92fc5"}},{"code_sha256_prefix":"9de1c96224c8f736","entry":"exist_time","repo":"lixiaotong97/ped","repo_kind":"official","path":"evaluate_metric_cpu.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/evaluate_metric_cpu.py","link_basis":"plan_row","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9de1c96224c8f736"}},{"code_sha256_prefix":"d836ce5b6cf41ab1","entry":"feature_reduce","repo":"lixiaotong97/ped","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d836ce5b6cf41ab1"}},{"code_sha256_prefix":"ae46af1e0d92d6f3","entry":"get_dataset","repo":"lixiaotong97/ped","repo_kind":"official","path":"get_dataloader.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/get_dataloader.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ae46af1e0d92d6f3"}},{"code_sha256_prefix":"c9c01f4f8a85c52b","entry":"get_logger0","repo":"lixiaotong97/ped","repo_kind":"official","path":"utils.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c9c01f4f8a85c52b"}},{"code_sha256_prefix":"114d0b11c94bc13a","entry":"pearson_coef","repo":"lixiaotong97/ped","repo_kind":"official","path":"rank_correlation.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/rank_correlation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"114d0b11c94bc13a"}},{"code_sha256_prefix":"5f7ccbd314b84fc4","entry":"rel_k","repo":"lixiaotong97/ped","repo_kind":"official","path":"rank_correlation.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/rank_correlation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5f7ccbd314b84fc4"}},{"code_sha256_prefix":"a8ae5c6e4eb58226","entry":"softmax","repo":"lixiaotong97/ped","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/metrics.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a8ae5c6e4eb58226"}},{"code_sha256_prefix":"a84eb8176fe90212","entry":"split_data","repo":"lixiaotong97/ped","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a84eb8176fe90212"}},{"code_sha256_prefix":"fb52994d0ed2666d","entry":"voc_ap","repo":"lixiaotong97/ped","repo_kind":"official","path":"finetune.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/finetune.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fb52994d0ed2666d"}},{"code_sha256_prefix":"da6e06cd5690114a","entry":"voc_eval_cls","repo":"lixiaotong97/ped","repo_kind":"official","path":"finetune.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/finetune.py","link_basis":"plan_row","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"da6e06cd5690114a"}},{"code_sha256_prefix":"1de00442bcc890b9","entry":"voc_eval_cls","repo":"lixiaotong97/ped","repo_kind":"official","path":"utils.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1de00442bcc890b9"}},{"code_sha256_prefix":"7eec34f32b165688","entry":"LogME_Score","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7eec34f32b165688"}},{"code_sha256_prefix":"5bcc456d9a7b66b9","entry":"PED_Score","repo":"lixiaotong97/PED","repo_kind":"official","path":"metrics.py","file_url":"https://github.com/lixiaotong97/PED/blob/HEAD/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5bcc456d9a7b66b9"}},{"code_sha256_prefix":"0302e6bc4693eb92","entry":"find_classes","repo":"lixiaotong97/ped","repo_kind":"official","path":"datasets/aircraft.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/datasets/aircraft.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"0302e6bc4693eb92"}},{"code_sha256_prefix":"6d9b5ef60c8859ac","entry":"make_dataset","repo":"lixiaotong97/ped","repo_kind":"official","path":"datasets/aircraft.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/datasets/aircraft.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6d9b5ef60c8859ac"}},{"code_sha256_prefix":"ee256f3a79df36be","entry":"make_dataset","repo":"lixiaotong97/ped","repo_kind":"official","path":"datasets/cars.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/datasets/cars.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ee256f3a79df36be"}},{"code_sha256_prefix":"a5affd54c4bb7f10","entry":"recall_k","repo":"lixiaotong97/ped","repo_kind":"official","path":"rank_correlation.py","file_url":"https://github.com/lixiaotong97/ped/blob/HEAD/rank_correlation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a5affd54c4bb7f10"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}