Papers › Region-based Non-local Operation for Video Classification

Region-based Non-local Operation for Video Classification

17 Jul 2020arXiv:2007.09033archive 2025-07-28

Guoxi Huang, Adrian G. Bors

Convolutional Neural Networks (CNNs) model long-range dependencies by deeply stacking convolution operations with small window sizes, which makes the optimizations difficult. This paper presents region-based non-local (RNL) operations as a family of self-attention mechanisms, which can directly capture long-range dependencies without using a deep stack of local operations. Given an intermediate feature map, our method recalibrates the feature at a position by aggregating the information from the neighboring regions of all positions. By combining a channel attention module with the proposed RNL, we design an attention chain, which can be integrated into the off-the-shelf CNNs for end-to-end training. We evaluate our method on two video classification benchmarks. The experimental results of our method outperform other attention mechanisms, and we achieve state-of-the-art performance on the Something-Something V1 dataset.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

guoxih/region-based-non-local-network officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action ClassificationAction RecognitionAction Recognition In VideosClassificationGeneral ClassificationVideo Classification

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Action Classification Kinetics-400 RNL+TSM Ensemble(ResNet50, 8 + 16 frames) Acc@1 77.4 #141 of 207 Archive leaderboard report
Action Recognition Something-Something V1 RNL+TSM Ensemble(R50+R101, ImageNet pretrained) Top 1 Accuracy 54.1 #33 of 74 Archive leaderboard report
Action Recognition Something-Something V1 RNL+TSM Ensemble(R50+R101, ImageNet pretrained) Top 5 Accuracy 82.2 #33 of 74 Archive leaderboard report
Action Recognition Something-Something V1 RNL+TSM Ensemble(ResNet50, ImageNet pretrained) Top 1 Accuracy 52.7 #40 of 74 Archive leaderboard report
Action Recognition Something-Something V1 RNL+TSM Ensemble(ResNet50, ImageNet pretrained) Top 5 Accuracy 81.5 #40 of 74 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingConvolutionDense ConnectionsMax PoolingNon-Local OperationReLUSigmoid Activation

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections