{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/fashionpedia-ontology-segmentation-and-an","title":"Fashionpedia: Ontology, Segmentation, and an Attribute Localization Dataset","arxiv_id":"2004.12276","date":"2020-04-26","proceeding":"ECCV 2020 8","authors":["Menglin Jia","Mengyun Shi","Mikhail Sirotenko","Yin Cui","Claire Cardie","Bharath Hariharan","Hartwig Adam","Serge Belongie"],"abstract":"In this work we explore the task of instance segmentation with attribute localization, which unifies instance segmentation (detect and segment each object instance) and fine-grained visual attribute categorization (recognize one or multiple attributes). The proposed task requires both localizing an object and describing its properties. To illustrate the various aspects of this task, we focus on the domain of fashion and introduce Fashionpedia as a step toward mapping out the visual aspects of the fashion world. Fashionpedia consists of two parts: (1) an ontology built by fashion experts containing 27 main apparel categories, 19 apparel parts, 294 fine-grained attributes and their relationships; (2) a dataset with everyday and celebrity event fashion images annotated with segmentation masks and their associated per-mask fine-grained attributes, built upon the Fashionpedia ontology. In order to solve this challenging task, we propose a novel Attribute-Mask RCNN model to jointly perform instance segmentation and localized attribute recognition, and provide a novel evaluation metric for the task. We also demonstrate instance segmentation models pre-trained on Fashionpedia achieve better transfer learning performance on other fashion datasets than ImageNet pre-training. Fashionpedia is available at: https://fashionpedia.github.io/home/index.html.","url_abs":"https://arxiv.org/abs/2004.12276v2","url_pdf":"https://arxiv.org/pdf/2004.12276v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/tensorflow/tpu/tree/master/models/official/detection/projects/fashionpedia","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":null},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/KMnP/fashionpedia-api","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/xushilin1/fashionformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/MindCode-4/code-13/tree/main/segmentation-dataset","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/MindCode-4/code-8/tree/main/segmentation-dataset","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/MindCode-4/code-9/tree/main/segmentation-dataset","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/cvdfoundation/fashionpedia","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"fashionpedia-ontology-segmentation-and-an","repo_url":"https://github.com/visipedia/imat_comp","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"fine-grained-visual-categorization","task_name":"Fine-Grained Visual Categorization"},{"task_slug":"fine-grained-visual-recognition","task_name":"Fine-Grained Visual Recognition"},{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[{"slug":"fashionpedia","name":"Fashionpedia","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2004.12276","atlas_url":"https://app.syntology.ai/?focus=2004.12276","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}