{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-comparative-assessment-of-multi-view-fusion","title":"A Comparative Assessment of Multi-view fusion learning for Crop Classification","arxiv_id":"2308.05407","date":"2023-08-10","proceeding":null,"authors":["Francisco Mena","Diego Arenas","Marlon Nuske","Andreas Dengel"],"abstract":"With a rapidly increasing amount and diversity of remote sensing (RS) data sources, there is a strong need for multi-view learning modeling. This is a complex task when considering the differences in resolution, magnitude, and noise of RS data. The typical approach for merging multiple RS sources has been input-level fusion, but other - more advanced - fusion strategies may outperform this traditional approach. This work assesses different fusion strategies for crop classification in the CropHarvest dataset. The fusion methods proposed in this work outperform models based on individual views and previous fusion methods. We do not find one single fusion method that consistently outperforms all other approaches. Instead, we present a comparison of multi-view fusion methods for three different datasets and show that, depending on the test region, different methods obtain the best performance. Despite this, we suggest a preliminary criterion for the selection of fusion methods.","url_abs":"https://arxiv.org/abs/2308.05407v1","url_pdf":"https://arxiv.org/pdf/2308.05407v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-comparative-assessment-of-multi-view-fusion","repo_url":"https://github.com/fmenat/multiviewcropclassification","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"crop-classification","task_name":"Crop Classification"},{"task_slug":"multi-view-learning","task_name":"MULTI-VIEW LEARNING"},{"task_slug":"sensor-fusion","task_name":"Sensor Fusion"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/crop-classification-on-cropharvest-kenya","task":"Crop Classification","dataset":"CropHarvest - Kenya","model":"Feature-level fusion (sum)","rank_in_archive_order":2,"of":5,"metrics":{"AUC":"0.716","Average Accuracy":"0.630","Target Binary F1":"0.794"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-kenya","task":"Crop Classification","dataset":"CropHarvest - Kenya","model":"Gated Fusion (Feature-level)","rank_in_archive_order":3,"of":5,"metrics":{"AUC":"0.718","Average Accuracy":"0.665","Target Binary F1":"0.772"},"uses_additional_data":false},{"leaderboard":"/sota/crop-classification-on-cropharvest-togo","task":"Crop Classification","dataset":"CropHarvest - Togo","model":"Ensemble aggregation","rank_in_archive_order":2,"of":4,"metrics":{"AUC":"0.909","Average Accuracy":"0.840","Target Binary F1":"0.778"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}