{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/atf-towards-robust-face-alignment-via","title":"ATF: Towards Robust Face Alignment via Leveraging Similarity and Diversity across Different Datasets","arxiv_id":null,"date":"2020-10-12","proceeding":"ACM MM 2020 10","authors":["Xing Lan","Qinghao Hu","Fangzhou Xiong","Cong Leng","Jian Cheng"],"abstract":"Face alignment is an important task in the field of multi-media. Together with the impressive progress of algorithms, various benchmark datasets have been released in recent years. Intuitively, it is meaningful to integrate multiple labeled datasets with different annotations to achieve higher performance on a target landmark detector. Although numerous efforts have been made in joint usage, there yet remain three shortages in recent works, e.g., additional computation, limitation of the markups scheme, and limited support for the regression method. To address the above problems, we proposed a novel Alternating Training Framework (ATF), which leverages similarity and diversity across multi-media sources for a more robust detector. Our framework mainly contains two sub-modules: Alternating Training with Decreasing Proportions (ATDP) and Mixed Branch Loss (mathcal LMB). In particular, ATDP trains multiple datasets simultaneously to take advantage of the diversity between them, while mathcal LMB utilizes similar landmark pairs to constrain different branches of corresponding datasets. Extensive experiments on various benchmarks show the effectiveness of our framework, and ATF is feasible for both heatmap-based network and direct coordinate regression. Specifically, the mean error even reaches 3.17 on the experiment on 300W leveraging WFLW, which significantly outperforms state-of-the-art methods. Both in an ordinary convolutional network (OCN) and HRNET, ATF achieves up to 9.96% relative improvement. Our source codes are made publicly available at https://github.com/starhiking/ATF.","url_abs":"https://dl.acm.org/doi/10.1145/3394171.3414037","url_pdf":"https://dl.acm.org/doi/10.1145/3394171.3414037","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"atf-towards-robust-face-alignment-via","repo_url":"https://github.com/starhiking/ATF","is_official":0,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"face-alignment","task_name":"Face Alignment"},{"task_slug":"robust-face-alignment","task_name":"Robust Face Alignment"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/face-alignment-on-300w","task":"Face Alignment","dataset":"300W","model":"ATF","rank_in_archive_order":16,"of":48,"metrics":{"NME_inter-ocular (%, Challenge)":"4.89","NME_inter-ocular (%, Common)":"2.75","NME_inter-ocular (%, Full)":"3.17"},"uses_additional_data":true},{"leaderboard":"/sota/face-alignment-on-aflw-19","task":"Face Alignment","dataset":"AFLW-19","model":"ATF","rank_in_archive_order":11,"of":23,"metrics":{"NME_diag (%, Full)":"1.55"},"uses_additional_data":true},{"leaderboard":"/sota/face-alignment-on-cofw","task":"Face Alignment","dataset":"COFW","model":"ATF","rank_in_archive_order":11,"of":28,"metrics":{"NME (inter-ocular)":"3.32%"},"uses_additional_data":true},{"leaderboard":"/sota/face-alignment-on-wfw-extra-data","task":"Face Alignment","dataset":"WFW (Extra Data)","model":"ATF","rank_in_archive_order":10,"of":11,"metrics":{"NME (inter-ocular)":"4.49"},"uses_additional_data":true}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}