{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/ubnormal-new-benchmark-for-supervised-open","title":"UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detection","arxiv_id":"2111.08644","date":"2021-11-16","proceeding":"CVPR 2022 1","authors":["Andra Acsintoae","Andrei Florescu","Mariana-Iuliana Georgescu","Tudor Mare","Paul Sumedrea","Radu Tudor Ionescu","Fahad Shahbaz Khan","Mubarak Shah"],"abstract":"Detecting abnormal events in video is commonly framed as a one-class classification task, where training videos contain only normal events, while test videos encompass both normal and abnormal events. In this scenario, anomaly detection is an open-set problem. However, some studies assimilate anomaly detection to action recognition. This is a closed-set scenario that fails to test the capability of systems at detecting new anomaly types. To this end, we propose UBnormal, a new supervised open-set benchmark composed of multiple virtual scenes for video anomaly detection. Unlike existing data sets, we introduce abnormal events annotated at the pixel level at training time, for the first time enabling the use of fully-supervised learning methods for abnormal event detection. To preserve the typical open-set formulation, we make sure to include disjoint sets of anomaly types in our training and test collections of videos. To our knowledge, UBnormal is the first video anomaly detection benchmark to allow a fair head-to-head comparison between one-class open-set models and supervised closed-set models, as shown in our experiments. Moreover, we provide empirical evidence showing that UBnormal can enhance the performance of a state-of-the-art anomaly detection framework on two prominent data sets, Avenue and ShanghaiTech. Our benchmark is freely available at https://github.com/lilygeorgescu/UBnormal.","url_abs":"https://arxiv.org/abs/2111.08644v3","url_pdf":"https://arxiv.org/pdf/2111.08644v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"ubnormal-new-benchmark-for-supervised-open","repo_url":"https://github.com/lilygeorgescu/ubnormal","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"event-detection","task_name":"Event Detection"},{"task_slug":"one-class-classification","task_name":"One-Class Classification"},{"task_slug":"video-anomaly-detection","task_name":"Video Anomaly Detection"}],"methods":[],"datasets_introduced":[{"slug":"ubnormal","name":"UBnormal","full_name":"University of Bucharest Abnormal Videos"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/anomaly-detection-on-chuk-avenue","task":"Anomaly Detection","dataset":"CUHK Avenue","model":"SSMTL+UBnormal","rank_in_archive_order":6,"of":35,"metrics":{"AUC":"93.0%","RBDC":"61.10","TBDC":"61.38"},"uses_additional_data":true},{"leaderboard":"/sota/anomaly-detection-on-shanghaitech","task":"Anomaly Detection","dataset":"ShanghaiTech","model":"SSMTL+UBnormal","rank_in_archive_order":9,"of":31,"metrics":{"AUC":"83.7%","RBDC":"47.15","TBDC":"86.15"},"uses_additional_data":true}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2111.08644","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.08644"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lilygeorgescu/ubnormal","reach":null}],"summary":{"ran_honours":1},"by_repo_kind":{"official":{"samples":1,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":1,"samples":[{"code_sha256_prefix":"54c7fc7c78c0095a","entry":"load_tracks","repo":"lilygeorgescu/ubnormal","repo_kind":"official","path":"scripts/create_tracks_for_tbdc_rbdc.py","file_url":"https://github.com/lilygeorgescu/ubnormal/blob/HEAD/scripts/create_tracks_for_tbdc_rbdc.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"54c7fc7c78c0095a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}