{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arboretum-a-large-multimodal-dataset-enabling","title":"BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversity","arxiv_id":"2406.17720","date":"2024-06-25","proceeding":null,"authors":["Chih-Hsuan Yang","Benjamin Feuer","Zaki Jubery","Zi K. Deng","Andre Nakkab","Md Zahid Hasan","Shivani Chiranjeevi","Kelly Marshall","Nirmal Baishnab","Asheesh K Singh","Arti Singh","Soumik Sarkar","Nirav Merchant","Chinmay Hegde","Baskar Ganapathysubramanian"],"abstract":"We introduce BioTrove, the largest publicly accessible dataset designed to advance AI applications in biodiversity. Curated from the iNaturalist platform and vetted to include only research-grade data, BioTrove contains 161.9 million images, offering unprecedented scale and diversity from three primary kingdoms: Animalia (\"animals\"), Fungi (\"fungi\"), and Plantae (\"plants\"), spanning approximately 366.6K species. Each image is annotated with scientific names, taxonomic hierarchies, and common names, providing rich metadata to support accurate AI model development across diverse species and ecosystems. We demonstrate the value of BioTrove by releasing a suite of CLIP models trained using a subset of 40 million captioned images, known as BioTrove-Train. This subset focuses on seven categories within the dataset that are underrepresented in standard image recognition models, selected for their critical role in biodiversity and agriculture: Aves (\"birds\"), Arachnida (\"spiders/ticks/mites\"), Insecta (\"insects\"), Plantae (\"plants\"), Fungi (\"fungi\"), Mollusca (\"snails\"), and Reptilia (\"snakes/lizards\"). To support rigorous assessment, we introduce several new benchmarks and report model accuracy for zero-shot learning across life stages, rare species, confounding species, and multiple taxonomic levels. We anticipate that BioTrove will spur the development of AI models capable of supporting digital tools for pest control, crop monitoring, biodiversity assessment, and environmental conservation. These advancements are crucial for ensuring food security, preserving ecosystems, and mitigating the impacts of climate change. BioTrove is publicly available, easily accessible, and ready for immediate use.","url_abs":"https://arxiv.org/abs/2406.17720v2","url_pdf":"https://arxiv.org/pdf/2406.17720v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"arboretum-a-large-multimodal-dataset-enabling","repo_url":"https://github.com/baskargroup/biotrove","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"arboretum-a-large-multimodal-dataset-enabling","repo_url":"https://github.com/baskargroup/Arboretum","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"}],"methods":[{"method_slug":"clip","method_name":"CLIP"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2406.17720","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.17720"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/baskargroup/biotrove","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/baskargroup/Arboretum","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":5,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"51ff8836051fdfad","entry":"get_prompts","repo":"baskargroup/Arboretum","repo_kind":"official","path":"model_validation/metadata/classname_gpt_sentence.py","file_url":"https://github.com/baskargroup/Arboretum/blob/HEAD/model_validation/metadata/classname_gpt_sentence.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"51ff8836051fdfad"}},{"code_sha256_prefix":"f98dabf5411c5da9","entry":"load_config","repo":"baskargroup/Arboretum","repo_kind":"official","path":"Biotrove-preprocess/biotrove_process/gen_filtered_shuffled_chunks.py","file_url":"https://github.com/baskargroup/Arboretum/blob/HEAD/Biotrove-preprocess/biotrove_process/gen_filtered_shuffled_chunks.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"f98dabf5411c5da9"}},{"code_sha256_prefix":"a77d0c98b9cb7fa9","entry":"load_config","repo":"baskargroup/Arboretum","repo_kind":"official","path":"Biotrove-preprocess/biotrove_process/gen_img_txt_pair.py","file_url":"https://github.com/baskargroup/Arboretum/blob/HEAD/Biotrove-preprocess/biotrove_process/gen_img_txt_pair.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a77d0c98b9cb7fa9"}},{"code_sha256_prefix":"cb2abfc87c731b57","entry":"load_config","repo":"baskargroup/Arboretum","repo_kind":"official","path":"Biotrove-preprocess/biotrove_process/get_imgs.py","file_url":"https://github.com/baskargroup/Arboretum/blob/HEAD/Biotrove-preprocess/biotrove_process/get_imgs.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"cb2abfc87c731b57"}},{"code_sha256_prefix":"36f6f16b5512c78e","entry":"make_splits","repo":"baskargroup/Arboretum","repo_kind":"official","path":"model_training/src/evaluation/data.py","file_url":"https://github.com/baskargroup/Arboretum/blob/HEAD/model_training/src/evaluation/data.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"36f6f16b5512c78e"}},{"code_sha256_prefix":"55da34222eabd553","entry":"img_loader","repo":"baskargroup/Arboretum","repo_kind":"official","path":"model_training/src/evaluation/data.py","file_url":"https://github.com/baskargroup/Arboretum/blob/HEAD/model_training/src/evaluation/data.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"55da34222eabd553"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}