{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/semeval-2020-task-8-memotion-analysis-the","title":"SemEval-2020 Task 8: Memotion Analysis -- The Visuo-Lingual Metaphor!","arxiv_id":"2008.03781","date":"2020-08-09","proceeding":null,"authors":["Chhavi Sharma","Deepesh Bhageria","William Scott","Srinivas PYKL","Amitava Das","Tanmoy Chakraborty","Viswanath Pulabaigari","Bjorn Gamback"],"abstract":"Information on social media comprises of various modalities such as textual, visual and audio. NLP and Computer Vision communities often leverage only one prominent modality in isolation to study social media. However, the computational processing of Internet memes needs a hybrid approach. The growing ubiquity of Internet memes on social media platforms such as Facebook, Instagram, and Twiter further suggests that we can not ignore such multimodal content anymore. To the best of our knowledge, there is not much attention towards meme emotion analysis. The objective of this proposal is to bring the attention of the research community towards the automatic processing of Internet memes. The task Memotion analysis released approx 10K annotated memes, with human-annotated labels namely sentiment (positive, negative, neutral), type of emotion (sarcastic, funny, offensive, motivation) and their corresponding intensity. The challenge consisted of three subtasks: sentiment (positive, negative, and neutral) analysis of memes, overall emotion (humour, sarcasm, offensive, and motivational) classification of memes, and classifying intensity of meme emotion. The best performances achieved were F1 (macro average) scores of 0.35, 0.51 and 0.32, respectively for each of the three subtasks.","url_abs":"https://arxiv.org/abs/2008.03781v1","url_pdf":"https://arxiv.org/pdf/2008.03781v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"semeval-2020-task-8-memotion-analysis-the","repo_url":"https://github.com/terenceylchow124/Meme-MultiModal","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"emotion-recognition","task_name":"Emotion Recognition"}],"methods":[],"datasets_introduced":[{"slug":"memotion-analysis","name":"SemEval-2020 Task-8","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2008.03781","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.03781"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/terenceylchow124/Meme-MultiModal","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":12},"by_repo_kind":{"listed":{"samples":12,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0c88c542763a7b8a","entry":"data_loader","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_loader.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_loader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c88c542763a7b8a"}},{"code_sha256_prefix":"cac98d7828027619","entry":"evaluate","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_train.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_train.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cac98d7828027619"}},{"code_sha256_prefix":"53c1a73f8e087319","entry":"evaluate","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_train_reddit.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_train_reddit.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"53c1a73f8e087319"}},{"code_sha256_prefix":"6dff50a6b6a32f0e","entry":"get_activation","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_train.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_train.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6dff50a6b6a32f0e"}},{"code_sha256_prefix":"684e2e3df1947e58","entry":"get_data","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_loader.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_loader.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"684e2e3df1947e58"}},{"code_sha256_prefix":"bef700d6e3bccf3a","entry":"load_model","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bef700d6e3bccf3a"}},{"code_sha256_prefix":"d513f70a7aca634e","entry":"metrics","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d513f70a7aca634e"}},{"code_sha256_prefix":"9f5bae48c0cdfe77","entry":"multiclass_acc","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9f5bae48c0cdfe77"}},{"code_sha256_prefix":"2c1dd97e9454f8f0","entry":"read_test_text","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/dataset/util_memotion.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/dataset/util_memotion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2c1dd97e9454f8f0"}},{"code_sha256_prefix":"3ba6020391a22217","entry":"read_train_text","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/dataset/util_memotion.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/dataset/util_memotion.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3ba6020391a22217"}},{"code_sha256_prefix":"0f216dad249caa43","entry":"train","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_train.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_train.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f216dad249caa43"}},{"code_sha256_prefix":"9030dcfb2479a83f","entry":"train","repo":"terenceylchow124/Meme-MultiModal","repo_kind":"listed","path":"utils/util_train_reddit.py","file_url":"https://github.com/terenceylchow124/Meme-MultiModal/blob/HEAD/utils/util_train_reddit.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9030dcfb2479a83f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}