Papers › Holistic Representation Learning for Multitask Trajectory Anomaly Detection

Holistic Representation Learning for Multitask Trajectory Anomaly Detection

3 Nov 2023arXiv:2311.01851archive 2025-07-28

Alexandros Stergiou, Brent De Weerdt, Nikos Deligiannis

Video anomaly detection deals with the recognition of abnormal events in videos. Apart from the visual signal, video anomaly detection has also been addressed with the use of skeleton sequences. We propose a holistic representation of skeleton trajectories to learn expected motions across segments at different times. Our approach uses multitask learning to reconstruct any continuous unobserved temporal segment of the trajectory allowing the extrapolation of past or future segments and the interpolation of in-between segments. We use an end-to-end attention-based encoder-decoder. We encode temporally occluded trajectories, jointly learn latent representations of the occluded segments, and reconstruct trajectories based on expected motions across different temporal segments. Extensive experiments on three trajectory-based video anomaly detection datasets show the advantages and effectiveness of our approach with state-of-the-art results on anomaly detection in skeleton trajectories.

PaperPDFCode

Code

alexandrosstergiou/TrajREC officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Anomaly DetectionDecoderRepresentation LearningVideo Anomaly Detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Anomaly Detection HR-Avenue TrajREC AUC 89.4 #1 of 11 Archive leaderboard report
Video Anomaly Detection HR-ShanghaiTech TrajREC AUC 77.9 #4 of 14 Archive leaderboard report
Video Anomaly Detection HR-UBnormal TrajREC AUC 68.2 #2 of 8 Archive leaderboard report
Video Anomaly Detection UBnormal TrajREC AUC 68% #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections