Papers › BeatNet: CRNN and Particle Filtering for Online Joint Beat Downbeat and Meter Tracking

BeatNet: CRNN and Particle Filtering for Online Joint Beat Downbeat and Meter Tracking

8 Aug 2021arXiv:2108.03576archive 2025-07-28

Mojtaba Heydari, Frank Cwitkowitz, Zhiyao Duan

The online estimation of rhythmic information, such as beat positions, downbeat positions, and meter, is critical for many real-time music applications. Musical rhythm comprises complex hierarchical relationships across time, rendering its analysis intrinsically challenging and at times subjective. Furthermore, systems which attempt to estimate rhythmic information in real-time must be causal and must produce estimates quickly and efficiently. In this work, we introduce an online system for joint beat, downbeat, and meter tracking, which utilizes causal convolutional and recurrent layers, followed by a pair of sequential Monte Carlo particle filters applied during inference. The proposed system does not need to be primed with a time signature in order to perform downbeat tracking, and is instead able to estimate meter and adjust the predictions over time. Additionally, we propose an information gate strategy to significantly decrease the computational cost of particle filtering during the inference step, making the system much faster than previous sampling-based methods. Experiments on the GTZAN dataset, which is unseen during training, show that the system outperforms various online beat and downbeat tracking systems and achieves comparable performance to a baseline offline joint method.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

mjhydri/beatnet officialmentioned in papermentioned on GitHubpytorchCC-BY-4.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Downbeat TrackingOnline Beat TrackingOnline Downbeat TrackingRhythm

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Online Beat Tracking Ballroom BeatNet F1 77.41 #1 of 3 Archive leaderboard report
Online Beat Tracking Ballroom IBT F1 70.79 #2 of 3 Archive leaderboard report
Online Beat Tracking Ballroom Aubio F1 56.73 #3 of 3 Archive leaderboard report
Online Beat Tracking GTZAN BeatNet F1 75.44 #2 of 7 Archive leaderboard report
Online Beat Tracking GTZAN Böck - Forward F1 74.18 #3 of 7 Archive leaderboard report
Online Beat Tracking GTZAN DLB F1 73.77 #4 of 7 Archive leaderboard report
Online Beat Tracking GTZAN IBT F1 68.99 #5 of 7 Archive leaderboard report
Online Beat Tracking GTZAN Böck - ACF F1 64.63 #6 of 7 Archive leaderboard report
Online Beat Tracking GTZAN Aubio F1 57.09 #7 of 7 Archive leaderboard report
Online Beat Tracking Rock Corpus BeatNet F1 73.13 #1 of 3 Archive leaderboard report
Online Beat Tracking Rock Corpus IBT F1 68.55 #2 of 3 Archive leaderboard report
Online Beat Tracking Rock Corpus Aubio F1 59.83 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections