{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/eyelids-intrinsic-motion-aware-feature","title":"Eyelid’s Intrinsic Motion-aware Feature Learning for Real-time Eyeblink Detection in the Wild","arxiv_id":null,"date":"2023-08-03","proceeding":"IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY 2023 8","authors":["Wenzheng Zeng","Yang Xiao","Guilei Hu","Zhiguo Cao","Sicheng Wei","Zhiwen Fang","Joey Tianyi Zhou","Junsong Yuan"],"abstract":"Real-time eyeblink detection in the wild is a recently emerged challenging task that suffers from dramatic variations in face attribute, pose, illumination, camera view and distance, etc. One key issue is to well characterize eyelid’s intrinsic motion (i.e., approaching and departure between upper and lower eyelid) robustly, under unconstrained conditions. Towards this, a novel eyelid’s intrinsic motion-aware feature learning approach is proposed. Our proposition lies in 3 folds. First, the feature extractor is led to focus on informative eye region adaptively via introducing visual attention in a coarse-to-fine way, to guarantee robustness and fine-grained descriptive ability jointly. Then, 2 constraints are proposed to make feature learning be aware of eyelid’s intrinsic motion. Particularly, one concerns the fact that the inter-frame feature divergence within eyeblink processes should be greater than non-eyeblink ones to better reveal eyelid’s intrinsic motion. The other constraint minimizes the inter-frame feature divergence of non-eyeblink samples, to suppress motion clues due to head or camera movement, illumination change, etc. Meanwhile, concerning the high ambiguity between eyeblink and non-eyeblink samples, soft sample labels are acquired via self-knowledge distillation to conduct feature learning with finer supervision than the hard ones. The experiments verify that, our proposition is significantly superior to the state-of-the-art ones, and with real-time running efficiency. It is also of strong generalization capacity towards constrained conditions.","url_abs":"https://ieeexplore-ieee-org.libproxy1.nus.edu.sg/abstract/document/10207771","url_pdf":"https://wenzhengzeng.github.io/data/blink_eyelid_final.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"eyelids-intrinsic-motion-aware-feature","repo_url":"https://github.com/wenzhengzeng/blink_eyelid","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"descriptive","task_name":"Descriptive"},{"task_slug":"eyeblink-detection","task_name":"Eyeblink detection"},{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"self-knowledge-distillation","task_name":"Self-Knowledge Distillation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/eyeblink-detection-on-hust-lebw","task":"Eyeblink detection","dataset":"HUST-LEBW","model":"Zeng et al.","rank_in_archive_order":1,"of":2,"metrics":{"Avg. F1 ":"91.345"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}