Papers › Neural Aggregation Network for Video Face Recognition

Neural Aggregation Network for Video Face Recognition

17 Mar 2016CVPR 2017 7arXiv:1603.05474archive 2025-07-28

Jiaolong Yang, Peiran Ren, Dong-Qing Zhang, Dong Chen, Fang Wen, Hongdong Li, Gang Hua

This paper presents a Neural Aggregation Network (NAN) for video face recognition. The network takes a face video or face image set of a person with a variable number of face images as its input, and produces a compact, fixed-dimension feature representation for recognition. The whole network is composed of two modules. The feature embedding module is a deep Convolutional Neural Network (CNN) which maps each face image to a feature vector. The aggregation module consists of two attention blocks which adaptively aggregate the feature vectors to form a single feature inside the convex hull spanned by them. Due to the attention mechanism, the aggregation is invariant to the image order. Our NAN is trained with a standard classification or verification loss without any extra supervision signal, and we found that it automatically learns to advocate high-quality face images while repelling low-quality ones such as blurred, occluded and improperly exposed faces. The experiments on IJB-A, YouTube Face, Celebrity-1000 video face recognition benchmarks show that it consistently outperforms naive aggregation methods and achieves the state-of-the-art accuracy.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Face IdentificationFace RecognitionFace Verification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Face Identification DroneSURF NAN (Adaface) Rank1 80.21 #3 of 6 Archive leaderboard report
Face Verification BTS3.1 NAN (Adaface) TAR @ FAR=0.01 0.5444 #3 of 7 Archive leaderboard report
Face Verification BTS3.1 MCN (Arcface) TAR @ FAR=0.01 0.3941 #6 of 7 Archive leaderboard report
Face Verification BTS3.1 NAN (Arcface) TAR @ FAR=0.01 0.3901 #7 of 7 Archive leaderboard report
Face Verification IJB-A NAN TAR @ FAR=0.01 94.10% #8 of 17 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections