{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ova-detr-open-vocabulary-aerial-object","title":"OVA-DETR: Open Vocabulary Aerial Object Detection Using Image-Text Alignment and Fusion","arxiv_id":"2408.12246","date":"2024-08-22","proceeding":null,"authors":["Guoting Wei","Xia Yuan","Yu Liu","Zhenhao Shang","Kelu Yao","Chao Li","Qingsen Yan","Chunxia Zhao","Haokui Zhang","Rong Xiao"],"abstract":"Aerial object detection has been a hot topic for many years due to its wide application requirements. However, most existing approaches can only handle predefined categories, which limits their applicability for the open scenarios in real-world. In this paper, we extend aerial object detection to open scenarios by exploiting the relationship between image and text, and propose OVA-DETR, a high-efficiency open-vocabulary detector for aerial images. Specifically, based on the idea of image-text alignment, we propose region-text contrastive loss to replace the category regression loss in the traditional detection framework, which breaks the category limitation. Then, we propose Bidirectional Vision-Language Fusion (Bi-VLF), which includes a dual-attention fusion encoder and a multi-level text-guided Fusion Decoder. The dual-attention fusion encoder enhances the feature extraction process in the encoder part. The multi-level text-guided Fusion Decoder is designed to improve the detection ability for small objects, which frequently appear in aerial object detection scenarios. Experimental results on three widely used benchmark datasets show that our proposed method significantly improves the mAP and recall, while enjoying faster inference speed. For instance, in zero shot detection experiments on DIOR, the proposed OVA-DETR outperforms DescReg and YOLO-World by 37.4% and 33.1%, respectively, while achieving 87 FPS inference speed, which is 7.9x faster than DescReg and 3x faster than YOLO-world. The code is available at https://github.com/GT-Wei/OVA-DETR.","url_abs":"https://arxiv.org/abs/2408.12246v1","url_pdf":"https://arxiv.org/pdf/2408.12246v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ova-detr-open-vocabulary-aerial-object","repo_url":"https://github.com/GT-Wei/RT-OVAD","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.12246","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.12246"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/GT-Wei/RT-OVAD","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_honours":3,"ran":5,"unverified":5},"by_repo_kind":{"official":{"samples":13,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"e0a06ded5d4f6c3c","entry":"box_cxcywh_to_xyxy","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/box_ops.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/box_ops.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e0a06ded5d4f6c3c"}},{"code_sha256_prefix":"ce749f837424dd8c","entry":"box_iou","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/box_ops.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/box_ops.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ce749f837424dd8c"}},{"code_sha256_prefix":"031b02fb990284ba","entry":"box_xyxy_to_cxcywh","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/box_ops.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/box_ops.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"031b02fb990284ba"}},{"code_sha256_prefix":"719ffaab32332a71","entry":"extract_schema","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/core/yaml_utils.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/core/yaml_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"719ffaab32332a71"}},{"code_sha256_prefix":"f4c8d56689a4f3bb","entry":"init_distributed","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/misc/dist.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/misc/dist.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f4c8d56689a4f3bb"}},{"code_sha256_prefix":"ac0b264881e880f3","entry":"register","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/core/yaml_utils.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/core/yaml_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ac0b264881e880f3"}},{"code_sha256_prefix":"4a10ae76733a083c","entry":"warp_loader","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/misc/dist.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/misc/dist.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4a10ae76733a083c"}},{"code_sha256_prefix":"fe4645cb6c103d24","entry":"warp_model","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/misc/dist.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/misc/dist.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fe4645cb6c103d24"}},{"code_sha256_prefix":"8c4a2df028bbf447","entry":"bias_init_with_prob","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/utils.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8c4a2df028bbf447"}},{"code_sha256_prefix":"da548fcd02ec18bd","entry":"create","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/core/yaml_utils.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/core/yaml_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"da548fcd02ec18bd"}},{"code_sha256_prefix":"9524bdc261cbc2dc","entry":"deformable_attention_core_func","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/utils.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9524bdc261cbc2dc"}},{"code_sha256_prefix":"676f3037319214be","entry":"get_contrastive_denoising_training_group","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/denoising.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/denoising.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"676f3037319214be"}},{"code_sha256_prefix":"2fff86fc7c917b0c","entry":"inverse_sigmoid","repo":"GT-Wei/RT-OVAD","repo_kind":"official","path":"src/zoo/itc_ovad/utils.py","file_url":"https://github.com/GT-Wei/RT-OVAD/blob/HEAD/src/zoo/itc_ovad/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2fff86fc7c917b0c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}