{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/exploring-hate-speech-detection-in-multimodal","title":"Exploring Hate Speech Detection in Multimodal Publications","arxiv_id":"1910.03814","date":"2019-10-09","proceeding":null,"authors":["Raul Gomez","Jaume Gibert","Lluis Gomez","Dimosthenis Karatzas"],"abstract":"In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze textual and visual information for hate speech detection, comparing them with unimodal detection. We provide quantitative and qualitative results and analyze the challenges of the proposed task. We find that, even though images are useful for the hate speech detection task, current multimodal models cannot outperform models analyzing only text. We discuss why and open the field and the dataset for further research.","url_abs":"https://arxiv.org/abs/1910.03814v1","url_pdf":"https://arxiv.org/pdf/1910.03814v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"exploring-hate-speech-detection-in-multimodal","repo_url":"https://github.com/gombru/multi-modal-hate-speech","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"hate-speech-detection","task_name":"Hate Speech Detection"}],"methods":[],"datasets_introduced":[{"slug":"mmhs150k","name":"MMHS150k","full_name":"Multimodal Hate Speech"}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1910.03814","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}