{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/holistic-representation-learning-for","title":"Holistic Representation Learning for Multitask Trajectory Anomaly Detection","arxiv_id":"2311.01851","date":"2023-11-03","proceeding":null,"authors":["Alexandros Stergiou","Brent De Weerdt","Nikos Deligiannis"],"abstract":"Video anomaly detection deals with the recognition of abnormal events in videos. Apart from the visual signal, video anomaly detection has also been addressed with the use of skeleton sequences. We propose a holistic representation of skeleton trajectories to learn expected motions across segments at different times. Our approach uses multitask learning to reconstruct any continuous unobserved temporal segment of the trajectory allowing the extrapolation of past or future segments and the interpolation of in-between segments. We use an end-to-end attention-based encoder-decoder. We encode temporally occluded trajectories, jointly learn latent representations of the occluded segments, and reconstruct trajectories based on expected motions across different temporal segments. Extensive experiments on three trajectory-based video anomaly detection datasets show the advantages and effectiveness of our approach with state-of-the-art results on anomaly detection in skeleton trajectories.","url_abs":"https://arxiv.org/abs/2311.01851v1","url_pdf":"https://arxiv.org/pdf/2311.01851v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"holistic-representation-learning-for","repo_url":"https://github.com/alexandrosstergiou/TrajREC","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"video-anomaly-detection","task_name":"Video Anomaly Detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/video-anomaly-detection-on-hr-avenue","task":"Video Anomaly Detection","dataset":"HR-Avenue","model":"TrajREC","rank_in_archive_order":1,"of":11,"metrics":{"AUC":"89.4"},"uses_additional_data":false},{"leaderboard":"/sota/video-anomaly-detection-on-hr-shanghaitech","task":"Video Anomaly Detection","dataset":"HR-ShanghaiTech","model":"TrajREC","rank_in_archive_order":4,"of":14,"metrics":{"AUC":"77.9"},"uses_additional_data":false},{"leaderboard":"/sota/video-anomaly-detection-on-hr-ubnormal","task":"Video Anomaly Detection","dataset":"HR-UBnormal","model":"TrajREC","rank_in_archive_order":2,"of":8,"metrics":{"AUC":"68.2"},"uses_additional_data":false},{"leaderboard":"/sota/video-anomaly-detection-on-ubnormal","task":"Video Anomaly Detection","dataset":"UBnormal","model":"TrajREC","rank_in_archive_order":4,"of":4,"metrics":{"AUC":"68%"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}