Papers › Multi-timescale Trajectory Prediction for Abnormal Human Activity Detection

Multi-timescale Trajectory Prediction for Abnormal Human Activity Detection

12 Aug 2019arXiv:1908.04321archive 2025-07-28

Royston Rodrigues, Neha Bhargava, Rajbabu Velmurugan, Subhasis Chaudhuri

A classical approach to abnormal activity detection is to learn a representation for normal activities from the training data and then use this learned representation to detect abnormal activities while testing. Typically, the methods based on this approach operate at a fixed timescale - either a single time-instant (eg. frame-based) or a constant time duration (eg. video-clip based). But human abnormal activities can take place at different timescales. For example, jumping is a short term anomaly and loitering is a long term anomaly in a surveillance scenario. A single and pre-defined timescale is not enough to capture the wide range of anomalies occurring with different time duration. In this paper, we propose a multi-timescale model to capture the temporal dynamics at different timescales. In particular, the proposed model makes future and past predictions at different timescales for a given input pose trajectory. The model is multi-layered where intermediate layers are responsible to generate predictions corresponding to different timescales. These predictions are combined to detect abnormal activities. In addition, we also introduce an abnormal activity data-set for research use that contains 4,83,566 annotated frames. Data-set will be made available at https://rodrigues-royston.github.io/Multi-timescale_Trajectory_Prediction/ Our experiments show that the proposed model can capture the anomalies of different time duration and outperforms existing methods.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action DetectionActivity DetectionAnomaly DetectionPredictionTrajectory PredictionVideo Anomaly Detection

Datasets

Introduced by this paper, per the archive.

IITB Corridor

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Anomaly Detection Corridor Multi-timescale Prediction AUC 67.12% #3 of 3 Archive leaderboard report
Anomaly Detection ShanghaiTech Multi-timescale Prediction AUC 76.03% #25 of 31 Archive leaderboard report
Video Anomaly Detection HR-Avenue Multi-timescale Prediction AUC 88.33 #3 of 11 Archive leaderboard report
Video Anomaly Detection HR-ShanghaiTech Multi-timescale Prediction AUC 77.0 #7 of 14 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections