{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/interspecies-knowledge-transfer-for-facial","title":"Interspecies Knowledge Transfer for Facial Keypoint Detection","arxiv_id":"1704.04023","date":"2017-04-13","proceeding":"CVPR 2017 7","authors":["Maheen Rashid","Xiuye Gu","Yong Jae Lee"],"abstract":"We present a method for localizing facial keypoints on animals by\ntransferring knowledge gained from human faces. Instead of directly finetuning\na network trained to detect keypoints on human faces to animal faces (which is\nsub-optimal since human and animal faces can look quite different), we propose\nto first adapt the animal images to the pre-trained human detection network by\ncorrecting for the differences in animal and human face shape. We first find\nthe nearest human neighbors for each animal image using an unsupervised shape\nmatching method. We use these matches to train a thin plate spline warping\nnetwork to warp each animal face to look more human-like. The warping network\nis then jointly finetuned with a pre-trained human facial keypoint detection\nnetwork using an animal dataset. We demonstrate state-of-the-art results on\nboth horse and sheep facial keypoint detection, and significant improvement\nover simple finetuning, especially when training data is scarce. Additionally,\nwe present a new dataset with 3717 images with horse face and facial keypoint\nannotations.","url_abs":"http://arxiv.org/abs/1704.04023v1","url_pdf":"http://arxiv.org/pdf/1704.04023v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"interspecies-knowledge-transfer-for-facial","repo_url":"https://github.com/menoRashid/animal_human_kp","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"torch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"human-detection","task_name":"Human Detection"},{"task_slug":"keypoint-detection","task_name":"Keypoint Detection"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=1704.04023","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}