{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/tasteset-recipe-dataset-and-food-entities","title":"TASTEset -- Recipe Dataset and Food Entities Recognition Benchmark","arxiv_id":"2204.07775","date":"2022-04-16","proceeding":null,"authors":["Ania Wróblewska","Agnieszka Kaliska","Maciej Pawłowski","Dawid Wiśniewski","Witold Sosnowski","Agnieszka Ławrynowicz"],"abstract":"Food Computing is currently a fast-growing field of research. Natural language processing (NLP) is also increasingly essential in this field, especially for recognising food entities. However, there are still only a few well-defined tasks that serve as benchmarks for solutions in this area. We introduce a new dataset -- called \\textit{TASTEset} -- to bridge this gap. In this dataset, Named Entity Recognition (NER) models are expected to find or infer various types of entities helpful in processing recipes, e.g.~food products, quantities and their units, names of cooking processes, physical quality of ingredients, their purpose, taste. The dataset consists of 700 recipes with more than 13,000 entities to extract. We provide a few state-of-the-art baselines of named entity recognition models, which show that our dataset poses a solid challenge to existing models. The best model achieved, on average, 0.95 $F_1$ score, depending on the entity type -- from 0.781 to 0.982. We share the dataset and the task to encourage progress on more in-depth and complex information extraction from recipes.","url_abs":"https://arxiv.org/abs/2204.07775v1","url_pdf":"https://arxiv.org/pdf/2204.07775v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tasteset-recipe-dataset-and-food-entities","repo_url":"https://github.com/taisti/tasteset","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"cg","task_name":"NER"},{"task_slug":"named-entity-recognition-1","task_name":"Named Entity Recognition"},{"task_slug":"named-entity-recognition-ner","task_name":"Named Entity Recognition (NER)"},{"task_slug":"named-entity-recognition","task_name":"named-entity-recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2204.07775","atlas_url":"https://app.syntology.ai/?focus=2204.07775","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.07775"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/taisti/tasteset","reach":null}],"summary":{"ran_violates":1,"ran_fixture":1,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"c191d39ec838e425","entry":"check_if_entity_correctly_began","repo":"taisti/tasteset","repo_kind":"official","path":"experiments/BERT.py","file_url":"https://github.com/taisti/tasteset/blob/HEAD/experiments/BERT.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c191d39ec838e425"}},{"code_sha256_prefix":"6c664fea7abbb58f","entry":"token_to_entity_predictions","repo":"taisti/tasteset","repo_kind":"official","path":"experiments/BERT.py","file_url":"https://github.com/taisti/tasteset/blob/HEAD/experiments/BERT.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c664fea7abbb58f"}},{"code_sha256_prefix":"3507ec55b62e1468","entry":"tokenize_and_align_labels","repo":"taisti/tasteset","repo_kind":"official","path":"experiments/BERT.py","file_url":"https://github.com/taisti/tasteset/blob/HEAD/experiments/BERT.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3507ec55b62e1468"}},{"code_sha256_prefix":"e2b9b4fc2b45e61c","entry":"bio_to_biluo","repo":"taisti/tasteset","repo_kind":"official","path":"src/utils.py","file_url":"https://github.com/taisti/tasteset/blob/HEAD/src/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e2b9b4fc2b45e61c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}