{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/toxic-language-detection-in-social-media-for","title":"Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis","arxiv_id":"2010.04543","date":"2020-10-09","proceeding":"Asian Chapter of the Association for Computational Linguistics 2020","authors":["João A. Leite","Diego F. Silva","Kalina Bontcheva","Carolina Scarton"],"abstract":"Hate speech and toxic comments are a common concern of social media platform users. Although these comments are, fortunately, the minority in these platforms, they are still capable of causing harm. Therefore, identifying these comments is an important task for studying and preventing the proliferation of toxicity in social media. Previous work in automatically detecting toxic comments focus mainly in English, with very few work in languages like Brazilian Portuguese. In this paper, we propose a new large-scale dataset for Brazilian Portuguese with tweets annotated as either toxic or non-toxic or in different types of toxicity. We present our dataset collection and annotation process, where we aimed to select candidates covering multiple demographic groups. State-of-the-art BERT models were able to achieve 76% macro-F1 score using monolingual data in the binary case. We also show that large-scale monolingual data is still needed to create more accurate models, despite recent advances in multilingual approaches. An error analysis and experiments with multi-label classification show the difficulty of classifying certain types of toxic comments that appear less frequently in our data and highlights the need to develop models that are aware of different categories of toxicity.","url_abs":"https://arxiv.org/abs/2010.04543v1","url_pdf":"https://arxiv.org/pdf/2010.04543v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"toxic-language-detection-in-social-media-for","repo_url":"https://github.com/JAugusto97/ToLD-Br","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"hate-speech-detection","task_name":"Hate Speech Detection"},{"task_slug":"multi-label-classification-2","task_name":"MUlTI-LABEL-ClASSIFICATION"},{"task_slug":"multi-label-classification","task_name":"Multi-Label Classification"},{"task_slug":"text-classification","task_name":"Text Classification"}],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bert","method_name":"BERT"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-linear-decay","method_name":"Linear Warmup With Linear Decay"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"weight-decay","method_name":"Weight Decay"},{"method_slug":"wordpiece","method_name":"WordPiece"}],"datasets_introduced":[{"slug":"told-br","name":"ToLD-Br","full_name":"Toxic Language Detection for Brazilian Portuguese"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/hate-speech-detection-on-told-br","task":"Hate Speech Detection","dataset":"ToLD-Br","model":"Multilingual BERT","rank_in_archive_order":1,"of":2,"metrics":{"F1-score":"0.75"},"uses_additional_data":false},{"leaderboard":"/sota/hate-speech-detection-on-told-br","task":"Hate Speech Detection","dataset":"ToLD-Br","model":"AutoML","rank_in_archive_order":2,"of":2,"metrics":{"F1-score":"0.74"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2010.04543","atlas_url":"https://app.syntology.ai/?focus=2010.04543","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}