Papers › Disentangled Variational Representation for Heterogeneous Face Recognition
Disentangled Variational Representation for Heterogeneous Face Recognition
Xiang Wu, Huaibo Huang, Vishal M. Patel, Ran He, Zhenan Sun
Visible (VIS) to near infrared (NIR) face matching is a challenging problem due to the significant domain discrepancy between the domains and a lack of sufficient data for training cross-modal matching algorithms. Existing approaches attempt to tackle this problem by either synthesizing visible faces from NIR faces, extracting domain-invariant features from these modalities, or projecting heterogeneous data onto a common latent space for cross-modal matching. In this paper, we take a different approach in which we make use of the Disentangled Variational Representation (DVR) for cross-modal matching. First, we model a face representation with an intrinsic identity information and its within-person variations. By exploring the disentangled latent variable space, a variational lower bound is employed to optimize the approximate posterior for NIR and VIS representations. Second, aiming at obtaining more compact and discriminative disentangled latent space, we impose a minimization of the identity information for the same subject and a relaxed correlation alignment constraint between the NIR and VIS modality variations. An alternative optimization scheme is proposed for the disentangled variational representation part and the heterogeneous face recognition network part. The mutual promotion between these two parts effectively reduces the NIR and VIS domain discrepancy and alleviates over-fitting. Extensive experiments on three challenging NIR-VIS heterogeneous face recognition databases demonstrate that the proposed method achieves significant improvements over the state-of-the-art methods.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Face Verification | BUAA-VisNir | DVR Wu et al. (2019) | TAR @ FAR=0.001 | 96.9 | #2 of 3 | Archive leaderboard | report |
| Face Verification | BUAA-VisNir | DVR Wu et al. (2019) | TAR @ FAR=0.01 | 98.5 | #2 of 3 | Archive leaderboard | report |
| Face Verification | CASIA NIR-VIS 2.0 | DVR Wu et al. (2019) | TAR @ FAR=0.001 | 99.6 | #2 of 3 | Archive leaderboard | report |
| Face Verification | Oulu-CASIA NIR-VIS | DVR Wu et al. (2019) | TAR @ FAR=0.001 | 84.9 | #2 of 3 | Archive leaderboard | report |
| Face Verification | Oulu-CASIA NIR-VIS | DVR Wu et al. (2019) | TAR @ FAR=0.01 | 97.2 | #2 of 3 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections