{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/semi-supervised-learning-for-face-sketch","title":"Semi-Supervised Learning for Face Sketch Synthesis in the Wild","arxiv_id":"1812.04929","date":"2018-12-12","proceeding":null,"authors":["Chaofeng Chen","Wei Liu","Xiao Tan","Kwan-Yee K. Wong"],"abstract":"Face sketch synthesis has made great progress in the past few years. Recent methods based on deep neural networks are able to generate high quality sketches from face photos. However, due to the lack of training data (photo-sketch pairs), none of such deep learning based methods can be applied successfully to face photos in the wild. In this paper, we propose a semi-supervised deep learning architecture which extends face sketch synthesis to handle face photos in the wild by exploiting additional face photos in training. Instead of supervising the network with ground truth sketches, we first perform patch matching in feature space between the input photo and photos in a small reference set of photo-sketch pairs. We then compose a pseudo sketch feature representation using the corresponding sketch feature patches to supervise our network. With the proposed approach, we can train our networks using a small reference set of photo-sketch pairs together with a large face photo dataset without ground truth sketches. Experiments show that our method achieve state-of-the-art performance both on public benchmarks and face photos in the wild. Codes are available at https://github.com/chaofengc/Face-Sketch-Wild.","url_abs":"https://arxiv.org/abs/1812.04929v2","url_pdf":"https://arxiv.org/pdf/1812.04929v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"semi-supervised-learning-for-face-sketch","repo_url":"https://github.com/chaofengc/Face-Sketch-Wild","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"face-sketch-synthesis","task_name":"Face Sketch Synthesis"},{"task_slug":"patch-matching","task_name":"Patch Matching"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/face-sketch-synthesis-on-cufs","task":"Face Sketch Synthesis","dataset":"CUFS","model":"Residual net + Pseudo Sketch Feature Loss + LSGAN","rank_in_archive_order":1,"of":4,"metrics":{"FSIM":"72.56%","SSIM":"54.63%"},"uses_additional_data":true},{"leaderboard":"/sota/face-sketch-synthesis-on-cufsf","task":"Face Sketch Synthesis","dataset":"CUFSF","model":"Residual net + Pseudo Sketch Feature Loss + LSGAN","rank_in_archive_order":3,"of":3,"metrics":{"FSIM":"71.59%","SSIM":"40.85%"},"uses_additional_data":false},{"leaderboard":"/sota/face-sketch-synthesis-on-cuhk","task":"Face Sketch Synthesis","dataset":"CUHK","model":"Residual net + Pseudo Sketch Feature Loss + LSGAN","rank_in_archive_order":1,"of":2,"metrics":{"FSIM":"74.23%","SSIM":"63.28%"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1812.04929","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}