{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/semeval-2021-task-6-detection-of-persuasion","title":"SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images","arxiv_id":"2105.09284","date":"2021-04-25","proceeding":"SEMEVAL 2021","authors":["Dimitar Dimitrov","Bishr Bin Ali","Shaden Shaar","Firoj Alam","Fabrizio Silvestri","Hamed Firooz","Preslav Nakov","Giovanni Da San Martino"],"abstract":"We describe SemEval-2021 task 6 on Detection of Persuasion Techniques in Texts and Images: the data, the annotation guidelines, the evaluation setup, the results, and the participating systems. The task focused on memes and had three subtasks: (i) detecting the techniques in the text, (ii) detecting the text spans where the techniques are used, and (iii) detecting techniques in the entire meme, i.e., both in the text and in the image. It was a popular task, attracting 71 registrations, and 22 teams that eventually made an official submission on the test set. The evaluation results for the third subtask confirmed the importance of both modalities, the text and the image. Moreover, some teams reported benefits when not just combining the two modalities, e.g., by using early or late fusion, but rather modeling the interaction between them in a joint model.","url_abs":"https://arxiv.org/abs/2105.09284v1","url_pdf":"https://arxiv.org/pdf/2105.09284v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"semeval-2021-task-6-detection-of-persuasion","repo_url":"https://github.com/di-dimitrov/SEMEVAL-2021-task6-corpus","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2105.09284","atlas_url":"https://app.syntology.ai/?focus=2105.09284","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.09284"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/di-dimitrov/SEMEVAL-2021-task6-corpus","reach":null}],"summary":{"ran_violates":1,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"listed":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"225b78b6dd217d03","entry":"check_format_task1_task3","repo":"di-dimitrov/SEMEVAL-2021-task6-corpus","repo_kind":"listed","path":"format_checker/task1_3.py","file_url":"https://github.com/di-dimitrov/SEMEVAL-2021-task6-corpus/blob/HEAD/format_checker/task1_3.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"225b78b6dd217d03"}},{"code_sha256_prefix":"08e612db25f6cfb2","entry":"read_classes","repo":"di-dimitrov/SEMEVAL-2021-task6-corpus","repo_kind":"listed","path":"format_checker/task1_3.py","file_url":"https://github.com/di-dimitrov/SEMEVAL-2021-task6-corpus/blob/HEAD/format_checker/task1_3.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"08e612db25f6cfb2"}},{"code_sha256_prefix":"7c09e8b2b1bf0d9b","entry":"evaluate","repo":"di-dimitrov/SEMEVAL-2021-task6-corpus","repo_kind":"listed","path":"scorer/task1_3.py","file_url":"https://github.com/di-dimitrov/SEMEVAL-2021-task6-corpus/blob/HEAD/scorer/task1_3.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7c09e8b2b1bf0d9b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}