{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/open-transmind-a-new-baseline-and-benchmark","title":"Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportation","arxiv_id":"2304.06051","date":"2023-04-12","proceeding":null,"authors":["Yifeng Shi","Feng Lv","Xinliang Wang","Chunlong Xia","Shaojie Li","Shujie Yang","Teng Xi","Gang Zhang"],"abstract":"With the continuous improvement of computing power and deep learning algorithms in recent years, the foundation model has grown in popularity. Because of its powerful capabilities and excellent performance, this technology is being adopted and applied by an increasing number of industries. In the intelligent transportation industry, artificial intelligence faces the following typical challenges: few shots, poor generalization, and a lack of multi-modal techniques. Foundation model technology can significantly alleviate the aforementioned issues. To address these, we designed the 1st Foundation Model Challenge, with the goal of increasing the popularity of foundation model technology in traffic scenarios and promoting the rapid development of the intelligent transportation industry. The challenge is divided into two tracks: all-in-one and cross-modal image retrieval. Furthermore, we provide a new baseline and benchmark for the two tracks, called Open-TransMind. According to our knowledge, Open-TransMind is the first open-source transportation foundation model with multi-task and multi-modal capabilities. Simultaneously, Open-TransMind can achieve state-of-the-art performance on detection, classification, and segmentation datasets of traffic scenarios. Our source code is available at https://github.com/Traffic-X/Open-TransMind.","url_abs":"https://arxiv.org/abs/2304.06051v2","url_pdf":"https://arxiv.org/pdf/2304.06051v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"open-transmind-a-new-baseline-and-benchmark","repo_url":"https://github.com/Traffic-X/Open-TransMind","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"paddle","reach":null}],"tasks":[{"task_slug":"2d-object-detection","task_name":"2D Object Detection"},{"task_slug":"image-retrieval","task_name":"Image Retrieval"},{"task_slug":"retrieval","task_name":"Retrieval"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/2d-object-detection-on-ceymo","task":"2D Object Detection","dataset":"CeyMo","model":"TransMind","rank_in_archive_order":1,"of":5,"metrics":{"mAP":"70.7"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2304.06051","atlas_url":"https://app.syntology.ai/?focus=2304.06051","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}