{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-a-unified-copernicus-foundation-model","title":"Towards a Unified Copernicus Foundation Model for Earth Vision","arxiv_id":"2503.11849","date":"2025-03-14","proceeding":null,"authors":["Yi Wang","Zhitong Xiong","Chenying Liu","Adam J. Stewart","Thomas Dujardin","Nikolaos Ioannis Bountos","Angelos Zavras","Franziska Gerken","Ioannis Papoutsis","Laura Leal-Taixé","Xiao Xiang Zhu"],"abstract":"Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most existing efforts remain limited to fixed spectral sensors, focus solely on the Earth's surface, and overlook valuable metadata beyond imagery. In this work, we take a step towards next-generation EO foundation models with three key components: 1) Copernicus-Pretrain, a massive-scale pretraining dataset that integrates 18.7M aligned images from all major Copernicus Sentinel missions, spanning from the Earth's surface to its atmosphere; 2) Copernicus-FM, a unified foundation model capable of processing any spectral or non-spectral sensor modality using extended dynamic hypernetworks and flexible metadata encoding; and 3) Copernicus-Bench, a systematic evaluation benchmark with 15 hierarchical downstream tasks ranging from preprocessing to specialized applications for each Sentinel mission. Our dataset, model, and benchmark greatly improve the scalability, versatility, and multimodal adaptability of EO foundation models, while also creating new opportunities to connect EO, weather, and climate research. Codes, datasets and models are available at https://github.com/zhu-xlab/Copernicus-FM.","url_abs":"https://arxiv.org/abs/2503.11849v2","url_pdf":"https://arxiv.org/pdf/2503.11849v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-a-unified-copernicus-foundation-model","repo_url":"https://github.com/zhu-xlab/copernicus-fm","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"earth-observation","task_name":"Earth Observation"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2503.11849","atlas_url":"https://app.syntology.ai/?focus=2503.11849","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.11849"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/zhu-xlab/Copernicus-FM","reach":null}],"summary":{"ran":4,"ran_fixture":2,"ran_honours":1,"unverified":3},"by_repo_kind":{"official":{"samples":10,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"d48963c8bdb3a78d","entry":"Dynamic_MLP_Decoder","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d48963c8bdb3a78d"}},{"code_sha256_prefix":"42441d19cc8600da","entry":"FCResLayer","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"42441d19cc8600da"}},{"code_sha256_prefix":"7d9edc2a3d24236e","entry":"FourierExpansion","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"7d9edc2a3d24236e"}},{"code_sha256_prefix":"44c4f86ffe6658ef","entry":"TransformerWeightGenerator","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"44c4f86ffe6658ef"}},{"code_sha256_prefix":"c3542266a3ce74b8","entry":"pi_resize_patch_embed","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"c3542266a3ce74b8"}},{"code_sha256_prefix":"6309ec0a6a89d1c8","entry":"resize_abs_pos_embed","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"6309ec0a6a89d1c8"}},{"code_sha256_prefix":"b1ae1923a93132d9","entry":"to_2tuple","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"b1ae1923a93132d9"}},{"code_sha256_prefix":"535ce86e57cd9815","entry":"Dynamic_MLP_OFA_spectral","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"535ce86e57cd9815"}},{"code_sha256_prefix":"577d53eab6d09b5a","entry":"Dynamic_MLP_OFA_variable","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"577d53eab6d09b5a"}},{"code_sha256_prefix":"79dca6bf2c6d2552","entry":"MaskedAutoencoderViT","repo":"zhu-xlab/Copernicus-FM","repo_kind":"official","path":"Copernicus-FM/src/models_mae_cfm.py","file_url":"https://github.com/zhu-xlab/Copernicus-FM/blob/HEAD/Copernicus-FM/src/models_mae_cfm.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"79dca6bf2c6d2552"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}