Browse State-of-the-Art › Activity Detection
Activity Detection
75 papers with code · 1 benchmark · 12 datasets archive 2025-07-28
Detecting activities in extended videos.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| AVA-Speech (4 rows) | CNN-BiLSTM_best | A Hybrid CNN-BiLSTM Voice Activity Detector | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
12 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 380 · with a code link: 75 · where Syntology ran a sample: 5 (3 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 380 tagged: 3 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 4: papers 1 to 100 of 380, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
17 Sep 2024 3 repositories listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)Our resulting model is the first real-time full-duplex spoken large language model, with a theoretical latency of 160ms, 200ms in practice, and is available at https://github.com/kyutai-labs/moshi.
-
12 Nov 2022 3 repositories listedEnd-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once.
-
23 Feb 2021 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)We also report the performance on the ROAD tasks of Slowfast and YOLOv5 detectors, as well as that of the winners of the ICCV2021 ROAD challenge, which highlight the challenges faced by situation awareness in autonomous…
-
4 Nov 2019 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We introduce pyannote. audio, an open-source toolkit written in Python for speaker diarization.
-
9 Jun 2019 3 repositories listedIn the end, a posteriori SNR weighted energy difference is applied to the extended pitch segments of the denoised speech signal for detecting voice activity.
-
9 Apr 2018 3 repositories listedIn this paper, we introduce a challenging new dataset, MLB-YouTube, designed for fine-grained activity detection.
-
22 Mar 2017 3 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)We address the problem of activity detection in continuous, untrimmed video streams.
-
28 Nov 2016 3 repositories listedWe propose a single neural network architecture for two tasks: on-line keyword spotting and voice activity detection.
-
29 Aug 2016 3 repositories listedThis thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed.
-
17 Jul 2023 2 repositories listedWe introduce "ivrit. ai", a comprehensive Hebrew speech dataset, addressing the distinct lack of extensive, high-quality resources for advancing Automated Speech Recognition (ASR) technology in Hebrew.
-
28 Nov 2021 2 repositories listedIn this paper, we reformulate this task as a single-label prediction problem by encoding the multi-speaker labels with power set.
-
12 Oct 2021 2 repositories listedWe propose a system that combines SAD and a BERT model to perform speaker change detection and speaker role detection (SRD) by chunking ASR transcripts, i. e., SD with a defined number of speakers together with SRD.
-
8 Apr 2021 2 repositories listedExperiments on multiple speaker diarization datasets conclude that our model can be used with great success on both voice activity detection and overlapped speech detection.
-
25 Nov 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)Speech activity detection and speaker diarization are used to extract segments from the videos that contain speech.
-
13 Feb 2020 2 repositories listedWith presence detection, how to collect training data with human presence can have a significant impact on the performance.
-
12 Aug 2019 2 repositories listedIn this paper, we propose "personal VAD", a system to detect the voice activity of a target speaker at the frame level.
-
5 Dec 2017 2 repositories listedIn this paper, we introduce the concept of learning latent super-events from activity videos, and present how it benefits activity detection in continuous videos.
-
3 Jun 2025 1 repository listedIn speaker diarization, traditional clustering-based methods remain widely used in real-world applications.
-
16 May 2025 1 repository listedWe assess the impact of denoising on diarization accuracy and compare various voice activity detection (VAD) models, including self-supervised transformer-based frame-wise VAD models.
-
28 Feb 2025 1 repository listedIn this paper, we investigate the ability of current-generation LLMs to identify text related to environmental activities.
-
17 Feb 2025 1 repository listedTo this end, we developed the VANPY (Voice Analysis in Python) framework for automated pre-processing, feature extraction, and classification of voice data.
-
12 Feb 2025 1 repository listedConclusion: We investigate the Team Time-Out and the StOP?-protocol in the OR, by presenting the first OR dataset with temporal annotations of group activities protocols, and introducing a novel group activity detection…
-
10 Feb 2025 1 repository listedOur simulation results demonstrate that the proposed scheme outperforms state-of-the-art mMIMO-based grant-free massive NOMA schemes with the same access latency.
-
24 Jan 2025 1 repository listedIn this work, we proposed deep learning models for the two tasks of the public MARIO Challenge at MICCAI 2024, designed to detect and forecast changes in nAMD severity with longitudinal retinal OCT.
-
19 Dec 2024 1 repository listedWe address the challenge of WiFi-based temporal activity detection and propose an efficient Dual Pyramid Network that integrates Temporal Signal Semantic Encoders and Local Sensitive Response Encoders.
-
1 Dec 2024 1 repository listedThis work introduces the first framework for reconstructing surgical dialogue from unstructured real-world recordings, which is crucial for characterizing teaching tasks.
-
15 Oct 2024 1 repository listedTo facilitate natural and intuitive interactions with diverse user groups in real-world settings, social robots must be capable of addressing the varying requirements and expectations of these groups while adapting…
-
6 Jun 2024 1 repository listedTwo existing SGS systems are evaluated on the corpus and compared against a baseline X-vector transfer learning strategy, trained on the development subset.
-
30 Jan 2024 1 repository listedThis problem is even more severe in cell-free networks as there are many of these parameters to be acquired.
-
30 Jan 2024 1 repository listedThe results show that our system improves the state-of-the-art on the AMI headset mix, using no oracle information and under full evaluation (no collar and including overlapped speech).
-
14 Aug 2023 1 repository listed
-
28 Jun 2023 1 repository listed
-
18 May 2023 1 repository listed
-
31 Mar 2023 1 repository listed
-
7 Mar 2023 1 repository listed
-
16 Nov 2022 1 repository listed
-
28 Oct 2022 1 repository listed
-
26 Oct 2022 1 repository listed
-
24 Oct 2022 1 repository listed
-
13 Jul 2022 1 repository listed
-
12 Jul 2022 1 repository listed
-
4 Jul 2022 1 repository listed
-
27 Jun 2022 1 repository listed
-
5 Apr 2022 1 repository listed
-
4 Apr 2022 1 repository listed
-
18 Mar 2022 1 repository listed
-
30 Jan 2022 1 repository listed
-
22 Jan 2022 1 repository listed
-
5 Jan 2022 1 repository listed
-
9 Dec 2021 1 repository listed
-
26 Nov 2021 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
2 Nov 2021 1 repository listed
-
18 Aug 2021 1 repository listed
-
29 Jul 2021 1 repository listed
-
13 Jun 2021 1 repository listed
-
12 Mar 2021 1 repository listed
-
5 Mar 2021 1 repository listed
-
1 Mar 2021 1 repository listed
-
14 Dec 2020 1 repository listed
-
28 Oct 2020 1 repository listed
-
21 Aug 2020 1 repository listed
-
9 Jun 2020 1 repository listed
-
27 Mar 2020 1 repository listed
-
2 Mar 2020 1 repository listed
-
15 Jan 2020 1 repository listed
-
18 Jun 2019 1 repository listed
-
1 Dec 2018 1 repository listed
-
21 Jul 2018 1 repository listed
-
16 Mar 2018 1 repository listed
-
1 Feb 2018 1 repository listed
-
18 Sep 2017 1 repository listed
-
8 Mar 2017 1 repository listed
-
7 Jul 2016 1 repository listed
-
1 Jun 2015 1 repository listed
-
28 Jun 2012 1 repository listed
-
CBF-AFA: Chunk-Based Multi-SSL Fusion for Automatic Fluency Assessment25 Jun 2025 0 repositories listed
-
Distributed Activity Detection for Cell-Free Hybrid Near-Far Field Communications17 Jun 2025 0 repositories listed
-
Attention Is Not Always the Answer: Optimizing Voice Activity Detection with Simple Feature Fusion2 Jun 2025 0 repositories listed
-
Joint Activity Detection and Channel Estimation for Massive Connectivity: Where Message Passing Meets Score-Based Generative Priors31 May 2025 0 repositories listed
-
Towards Robust Overlapping Speech Detection: A Speaker-Aware Progressive Approach Using WavLM29 May 2025 0 repositories listed
-
Robust Activity Detection for Massive Random Access21 May 2025 0 repositories listed
-
Improving endpoint detection in end-to-end streaming ASR for conversational speech19 May 2025 0 repositories listed
-
MicroNAS: An Automated Framework for Developing a Fall Detection System10 Apr 2025 0 repositories listed
-
Fast MLE and MAPE-Based Device Activity Detection for Grant-Free Access via PSCA and PSCA-Net19 Mar 2025 0 repositories listed
-
Federated Learning for Secure and Efficient Device Activity Detection in mMTC Networks14 Mar 2025 0 repositories listed
-
Lightweight Learning for Grant-Free Activity Detection in Cell-Free Massive MIMO Networks14 Mar 2025 0 repositories listed
-
Robust Learning-Based Sparse Recovery for Device Activity Detection in Grant-Free Random Access Cell-Free Massive MIMO: Enhancing Resilience to Impairments13 Mar 2025 0 repositories listed
-
CADDI: An in-Class Activity Detection Dataset using IMU data from low-cost sensors4 Mar 2025 0 repositories listed
-
Mixture of Experts-augmented Deep Unfolding for Activity Detection in IRS-aided Systems27 Feb 2025 0 repositories listed
-
Unveiling ECC Vulnerabilities: LSTM Networks for Operation Recognition in Side-Channel Attacks24 Feb 2025 0 repositories listed
-
FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems19 Feb 2025 0 repositories listed
-
LLM-Enhanced Dialogue Management for Full-Duplex Spoken Dialogue Systems19 Feb 2025 0 repositories listed
-
DT4ECG: A Dual-Task Learning Framework for ECG-Based Human Identity Recognition and Human Activity Detection16 Feb 2025 0 repositories listed
-
Unveiling the Power of Complex-Valued Transformers in Wireless Communications16 Feb 2025 0 repositories listed
-
Microphone Array Geometry Independent Multi-Talker Distant ASR: NTT System for the DASR Task of the CHiME-8 Challenge14 Feb 2025 0 repositories listed
-
Universal Speaker Embedding Free Target Speaker Extraction and Personal Voice Activity Detection7 Jan 2025 0 repositories listed
-
Noise-Robust Target-Speaker Voice Activity Detection Through Self-Supervised Pretraining6 Jan 2025 0 repositories listed
-
Fotheidil: an Automatic Transcription System for the Irish Language31 Dec 2024 0 repositories listed
-
Comparative Analysis of Deep Learning Approaches for Harmful Brain Activity Detection Using EEG10 Dec 2024 0 repositories listed
-
Asynchronous Random Access in Massive MIMO Systems Facilitated by the Delay-Angle Domain6 Dec 2024 0 repositories listed
Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections