Methods › Computer Vision › Image Feature Extractors › Non-Local Operation
Non-Local Operation
Introduced by Xiaolong Wang et al. in Non-local Neural Networks
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
A Non-Local Operation is a component for capturing long-range dependencies with deep neural networks. It is a generalization of the classical non-local mean operation in computer vision. Intuitively a non-local operation computes the response at a position as a weighted sum of the features at all positions in the input feature maps. The set of positions can be in space, time, or spacetime, implying that these operations are applicable for image, sequence, and video problems.
Following the non-local mean operation, a generic non-local operation for deep neural networks is defined as:
𝕪ᵢ = 1/(𝒞(𝕩))∑_(∀j)f(𝕩ᵢ, 𝕩ⱼ)g(𝕩ⱼ)
Here i is the index of an output position (in space, time, or spacetime) whose response is to be computed and j is the index that enumerates all possible positions. x is the input signal (image, sequence, video; often their features) and y is the output signal of the same size as x. A pairwise function f computes a scalar (representing relationship such as affinity) between i and all j. The unary function g computes a representation of the input signal at the position j. The response is normalized by a factor C(x).
The non-local behavior is due to the fact that all positions (∀j) are considered in the operation. As a comparison, a convolutional operation sums up the weighted input in a local neighborhood (e.g., i − 1 ≤j ≤i + 1 in a 1D case with kernel size 3), and a recurrent operation at time i is often based only on the current and the latest time steps (e.g., j = i or i − 1).
The non-local operation is also different from a fully-connected (fc) layer. The equation above computes responses based on relationships between different locations, whereas fc uses learned weights. In other words, the relationship between xⱼ and xᵢ is not a function of the input data in fc, unlike in nonlocal layers. Furthermore, the formulation in the equation above supports inputs of variable sizes, and maintains the corresponding size in the output. On the contrary, an fc layer requires a fixed-size input/output and loses positional correspondence (e.g., that from xᵢ to yᵢ at the position i).
A non-local operation is a flexible building block and can be easily used together with convolutional/recurrent layers. It can be added into the earlier part of deep neural networks, unlike fc layers that are often used in the end. This allows us to build a richer hierarchy that combines both non-local and local information.
In terms of parameterisation, we usually parameterise g as a linear embedding of the form g(xⱼ) = W_g𝕩ⱼ , where W_g is a weight matrix to be learned. This is implemented as, e.g., 1×1 convolution in space or 1×1×1 convolution in spacetime. For f we use an affinity function, a list of which can be found here.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: disentangled non-local block; Hybrid Non-local Optimization; Lorentz Local Canonicalization (LLoCa); Non-Local Latent Relation Distillation; Efficient Non-Local Contrastive Network; Diagonal Adaptive Non-local Observables; Efficient Non-Local Contrastive Attention; energy score as a non-local proper scoring rule.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 181 · with a code link: 98 · where Syntology ran a sample: 30 (25 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (30 of 181 tagged: 25 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 181, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Robust Lane Detection with Wavelet-Enhanced Context Modeling and Adaptive Sampling 24 Mar 2025 · 0 repositories · arXiv:2503.18631
-
ParaGAN: A Scalable Distributed Training Framework for Generative Adversarial Networks 6 Nov 2024 · 0 repositories · arXiv:2411.03999
-
Unsupervised Panoptic Interpretation of Latent Spaces in GANs Using Space-Filling Vector Quantization 27 Oct 2024 · 1 repository · arXiv:2410.20573
-
Enhancing Tree Type Detection in Forest Fire Risk Assessment: Multi-Stage Approach and Color Encoding with Forest Fire Risk Evaluation Framework for UAV Imagery 27 Jul 2024 · 0 repositories · arXiv:2407.19184
-
A Scalable Quantum Non-local Neural Network for Image Classification 26 Jul 2024 · 1 repository · arXiv:2407.18906
-
Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Models 24 May 2024 · 1 repository · arXiv:2405.15349Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Deep Learning-Based CSI Feedback for XL-MIMO Systems in the Near-Field Domain 15 May 2024 · 0 repositories · arXiv:2405.09053
-
Vision-based Food Nutrition Estimation via RGB-D Fusion Network 25 Oct 2023 · 1 repository
-
Accurate and lightweight dehazing via multi-receptive-field non-local network and novel contrastive regularization 28 Sep 2023 · 0 repositories · arXiv:2309.16494
-
On quantifying and improving realism of images generated with diffusion 26 Sep 2023 · 0 repositories · arXiv:2309.14756
-
Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flows 21 Sep 2023 · 0 repositories
-
A Strategic Framework for Optimal Decisions in Football 1-vs-1 Shot-Taking Situations: An Integrated Approach of Machine Learning, Theory-Based Modeling, and Game Theory 27 Jul 2023 · 2 repositories · arXiv:2307.14732
-
Pyrus Base: An Open Source Python Framework for the RoboCup 2D Soccer Simulation 22 Jul 2023 · 1 repository · arXiv:2307.16875
-
Diffusion Models Beat GANs on Image Classification 17 Jul 2023 · 1 repository · arXiv:2307.08702
-
Diversity is Strength: Mastering Football Full Game with Interactive Reinforcement Learning of Multiple AIs 28 Jun 2023 · 0 repositories · arXiv:2306.15903
-
Rosetta Neurons: Mining the Common Units in a Model Zoo 15 Jun 2023 · 0 repositories · arXiv:2306.09346
-
Toward more accurate and generalizable brain deformation estimators for traumatic brain injury detection with unsupervised domain adaptation 8 Jun 2023 · 0 repositories · arXiv:2306.05255
-
FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator 7 Jun 2023 · 0 repositories · arXiv:2306.07936
-
Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning 29 May 2023 · 0 repositories · arXiv:2305.17886
-
Is Centralized Training with Decentralized Execution Framework Centralized Enough for MARL? 27 May 2023 · 1 repository · arXiv:2305.17352Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations 22 May 2023 · 0 repositories · arXiv:2305.13030
-
An Empirical Study on Google Research Football Multi-agent Scenarios 16 May 2023 · 1 repository · arXiv:2305.09458
-
The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation 5 May 2023 · 1 repository · arXiv:2305.03369
-
SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenes 11 Apr 2023 · 1 repository · arXiv:2304.05170
-
VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Views 10 Apr 2023 · 1 repository · arXiv:2304.04617
-
Towards Active Learning for Action Spotting in Association Football Videos 9 Apr 2023 · 0 repositories · arXiv:2304.04220
-
A Hybrid Multi-Scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis 7 Apr 2023 · 1 repository
-
Exemplar-based Video Colorization with Long-term Spatiotemporal Dependency 27 Mar 2023 · 0 repositories · arXiv:2303.15081
-
Embedding Contextual Information through Reward Shaping in Multi-Agent Learning: A Case Study from Google Football 25 Mar 2023 · 0 repositories · arXiv:2303.15471
-
Deep Generative Multi-Agent Imitation Model as a Computational Benchmark for Evaluating Human Performance in Complex Interactive Tasks: A Case Study in Football 23 Mar 2023 · 0 repositories · arXiv:2303.13323
-
High Fidelity Image Synthesis With Deep VAEs In Latent Space 23 Mar 2023 · 2 repositories · arXiv:2303.13714Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images 13 Mar 2023 · 0 repositories · arXiv:2303.07274
-
NFL Career Success as Predicted by NFL Scouting Combine 10 Mar 2023 · 1 repository · arXiv:2303.05774
-
Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoning 7 Mar 2023 · 1 repository · arXiv:2303.08046
-
Identification of pattern mining algorithm for rugby league players positional groups separation based on movement patterns 25 Feb 2023 · 0 repositories · arXiv:2302.14058
-
Transformer-Based Neural Marked Spatio Temporal Point Process Model for Football Match Events Analysis 18 Feb 2023 · 1 repository · arXiv:2302.09276
-
TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play 15 Feb 2023 · 1 repository · arXiv:2302.07515
-
Inferring Player Location in Sports Matches: Multi-Agent Spatial Imputation from Limited Observations 13 Feb 2023 · 0 repositories · arXiv:2302.06569
-
Order Matters: Agent-by-agent Policy Optimization 13 Feb 2023 · 1 repository · arXiv:2302.06205Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
Impact of velocity and impact angle on football shot accuracy during fundamental trainings 7 Feb 2023 · 0 repositories · arXiv:2302.03426
-
KDEformer: Accelerating Transformers via Kernel Density Estimation 5 Feb 2023 · 1 repository · arXiv:2302.02451Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)
-
Design and Implementation of A Soccer Ball Detection System with Multiple Cameras 31 Jan 2023 · 0 repositories · arXiv:2302.00123
-
Potential Penetrative Pass (P3) 26 Jan 2023 · 0 repositories · arXiv:2302.10760
-
Event Detection in Football using Graph Convolutional Networks 24 Jan 2023 · 0 repositories · arXiv:2301.10052
-
A Machine Learning Approach for Player and Position Adjusted Expected Goals in Football (Soccer) 19 Jan 2023 · 0 repositories · arXiv:2301.13052
-
Sentiment Analysis for Measuring Hope and Fear from Reddit Posts During the 2022 Russo-Ukrainian Conflict 19 Jan 2023 · 0 repositories · arXiv:2301.08347
-
Impact of the Euro 2020 championship on the spread of COVID-19 18 Jan 2023 · 2 repositories · arXiv:2301.07659
-
Exploring Intra-Class Variation Factors With Learnable Cluster Prompts for Semi-Supervised Image Synthesis 1 Jan 2023 · 0 repositories
-
Denoising instrumented mouthguard measurements of head impact kinematics with a convolutional neural network 19 Dec 2022 · 0 repositories · arXiv:2212.09832
-
Hierarchical Strategies for Cooperative Multi-Agent Reinforcement Learning 14 Dec 2022 · 0 repositories · arXiv:2212.07397
-
Location analysis of players in UEFA EURO 2020 and 2022 using generalized valuation of defense by estimating probabilities 30 Nov 2022 · 1 repository · arXiv:2212.00021
-
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency 29 Nov 2022 · 1 repository · arXiv:2211.16068Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Predicting Football Match Outcomes with eXplainable Machine Learning and the Kelly Index 28 Nov 2022 · 0 repositories · arXiv:2211.15734
-
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN 16 Nov 2022 · 0 repositories · arXiv:2211.08742
-
Gambling on Momentum 11 Nov 2022 · 0 repositories · arXiv:2211.06052
-
Going for GOAL: A Resource for Grounded Football Commentaries 8 Nov 2022 · 1 repository · arXiv:2211.04534
-
Graph-Based Multi-Camera Soccer Player Tracker 3 Nov 2022 · 0 repositories · arXiv:2211.02125
-
Teacher-student curriculum learning for reinforcement learning 31 Oct 2022 · 0 repositories · arXiv:2210.17368
-
Recursive Reasoning in Minimax Games: A Level k Gradient Play Method 29 Oct 2022 · 1 repository · arXiv:2210.16482
-
Group Distributionally Robust Reinforcement Learning with Hierarchical Latent Variables 21 Oct 2022 · 0 repositories · arXiv:2210.12262
-
PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning 17 Oct 2022 · 0 repositories · arXiv:2210.08872
-
Betting the system: Using lineups to predict football scores 12 Oct 2022 · 0 repositories · arXiv:2210.06327
-
ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Reward 9 Oct 2022 · 1 repository · arXiv:2210.04365
-
Brain structure can mediate or moderate the relationship of behavior to brain function and transcriptome. A preliminary study 6 Oct 2022 · 0 repositories · arXiv:2210.03195
-
Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results 28 Sep 2022 · 2 repositories · arXiv:2209.14272
-
Identifying and Extracting Football Features from Real-World Media Sources using Only Synthetic Training Data 27 Sep 2022 · 0 repositories · arXiv:2209.13254
-
Observation Centric and Central Distance Recovery on Sports Player Tracking 27 Sep 2022 · 1 repository · arXiv:2209.13154
-
Hybrid Multimodal Fusion for Humor Detection 24 Sep 2022 · 0 repositories · arXiv:2209.11949
-
Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Games 21 Sep 2022 · 0 repositories · arXiv:2209.10055
-
Evaluation of 3D GANs for Lung Tissue Modelling in Pulmonary CT 17 Aug 2022 · 1 repository · arXiv:2208.08184
-
SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs 8 Aug 2022 · 1 repository · arXiv:2208.04226
-
GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond 29 Jul 2022 · 1 repository · arXiv:2207.14812Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples)
-
BigColor: Colorization using a Generative Color Prior for Natural Images 20 Jul 2022 · 1 repository · arXiv:2207.09685Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Pseudo-Pair based Self-Similarity Learning for Unsupervised Person Re-identification 9 Jul 2022 · 0 repositories · arXiv:2207.13035
-
A Mask Attention Interaction and Scale Enhancement Network for SAR Ship Instance Segmentation 8 Jul 2022 · 0 repositories · arXiv:2207.03912
-
StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis 19 Jun 2022 · 2 repositories · arXiv:2206.09479Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
OSSGAN: Open-Set Semi-Supervised Image Generation 29 Apr 2022 · 1 repository · arXiv:2204.14249Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
Interpreting Class Conditional GANs with Channel Awareness 21 Mar 2022 · 0 repositories · arXiv:2203.11173
-
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance 5 Mar 2022 · 0 repositories · arXiv:2203.02770
-
Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values 3 Mar 2022 · 1 repository · arXiv:2203.01993
-
When do GANs replicate? On the choice of dataset size 23 Feb 2022 · 1 repository · arXiv:2202.11765
-
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations 12 Jan 2022 · 0 repositories · arXiv:2201.04684
-
KNN Local Attention for Image Restoration 1 Jan 2022 · 0 repositories
-
Think Twice Before Detecting GAN-Generated Fake Images From Their Spectral Domain Imprints 1 Jan 2022 · 0 repositories
-
DGL-GAN: Discriminator Guided Learning for GAN Compression 13 Dec 2021 · 1 repository · arXiv:2112.06502
-
Fracture Detection in Wrist X-ray Images Using Deep Learning-Based Object Detection Models 14 Nov 2021 · 0 repositories · arXiv:2111.07355
-
Scatterbrain: Unifying Sparse and Low-rank Attention Approximation 28 Oct 2021 · 1 repository · arXiv:2110.15343Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Sparse Unbalanced GAN Training with In-Time Over-Parameterization 29 Sep 2021 · 0 repositories
-
Aesthetics and neural network image representations 16 Sep 2021 · 0 repositories · arXiv:2109.08103
-
Instance-Conditioned GAN 10 Sep 2021 · 1 repository · arXiv:2109.05070
-
Improving generative adversarial network inversion via fine-tuning GAN encoders 23 Aug 2021 · 4 repositories · arXiv:2108.10201
-
Towards Balanced Learning for Instance Recognition 23 Aug 2021 · 0 repositories · arXiv:2108.10175
-
FoodLogoDet-1500: A Dataset for Large-Scale Food Logo Detection via Multi-Scale Feature Decoupling Network 10 Aug 2021 · 1 repository · arXiv:2108.04644
-
Sinogram Denoise Based on Generative Adversarial Networks 9 Aug 2021 · 0 repositories · arXiv:2108.03903
-
Unrealistic Feature Suppression for Generative Adversarial Networks 23 Jul 2021 · 0 repositories · arXiv:2107.11047
-
CoSMo: Content-Style Modulation for Image Retrieval With Text Feedback 19 Jun 2021 · 1 repository
-
Direct Reconstruction of Linear Parametric Images from Dynamic PET Using Nonlocal Deep Image Prior 18 Jun 2021 · 0 repositories · arXiv:2106.10359
-
Salient Positions based Attention Network for Image Classification 9 Jun 2021 · 1 repository · arXiv:2106.04996
-
Cascaded Diffusion Models for High Fidelity Image Generation 30 May 2021 · 0 repositories · arXiv:2106.15282
-
Scatterbrain: Unifying Sparse and Low-rank Attention 21 May 2021 · 1 repository
Tasks archive 2025-07-28
20 shown of 197 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections