{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cascaded-dual-vision-transformer-for-accurate","title":"Cascaded Dual Vision Transformer for Accurate Facial Landmark Detection","arxiv_id":"2411.07167","date":"2024-11-08","proceeding":null,"authors":["Ziqiang Dang","Jianfang Li","Lin Liu"],"abstract":"Facial landmark detection is a fundamental problem in computer vision for many downstream applications. This paper introduces a new facial landmark detector based on vision transformers, which consists of two unique designs: Dual Vision Transformer (D-ViT) and Long Skip Connections (LSC). Based on the observation that the channel dimension of feature maps essentially represents the linear bases of the heatmap space, we propose learning the interconnections between these linear bases to model the inherent geometric relations among landmarks via Channel-split ViT. We integrate such channel-split ViT into the standard vision transformer (i.e., spatial-split ViT), forming our Dual Vision Transformer to constitute the prediction blocks. We also suggest using long skip connections to deliver low-level image features to all prediction blocks, thereby preventing useful information from being discarded by intermediate supervision. Extensive experiments are conducted to evaluate the performance of our proposal on the widely used benchmarks, i.e., WFLW, COFW, and 300W, demonstrating that our model outperforms the previous SOTAs across all three benchmarks.","url_abs":"https://arxiv.org/abs/2411.07167v1","url_pdf":"https://arxiv.org/pdf/2411.07167v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cascaded-dual-vision-transformer-for-accurate","repo_url":"https://github.com/Human3DAIGC/AccurateFacialLandmarkDetection","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"facial-landmark-detection","task_name":"Facial Landmark Detection"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"heatmap","method_name":"Heatmap"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer","method_name":"Transformer"},{"method_slug":"vision-transformer","method_name":"Vision Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/facial-landmark-detection-on-300w","task":"Facial Landmark Detection","dataset":"300W","model":"D-ViT","rank_in_archive_order":1,"of":15,"metrics":{"NME":"2.85"},"uses_additional_data":false},{"leaderboard":"/sota/facial-landmark-detection-on-cofw","task":"Facial Landmark Detection","dataset":"COFW","model":"D-ViT","rank_in_archive_order":1,"of":2,"metrics":{"NME (inter-pupil)":"4.13"},"uses_additional_data":false},{"leaderboard":"/sota/facial-landmark-detection-on-wflw-1","task":"Facial Landmark Detection","dataset":"WFLW","model":"D-ViT","rank_in_archive_order":1,"of":3,"metrics":{"AUC@10 (inter-ocular)":"63.7","FR@10 (inter-ocular)":"1.76","NME":"3.75","NME (inter-ocular)":"3.75"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2411.07167","atlas_url":"https://app.syntology.ai/?focus=2411.07167","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}