{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/aspect-based-sentiment-analysis-using-bert","title":"Aspect-based Sentiment Analysis using BERT with Disentangled Attention","arxiv_id":null,"date":"2021-07-18","proceeding":"ICML 2021 - LXAI Workshop 2021 7","authors":["Emanuel H. Silva","Ricardo M. Marcacini"],"abstract":"Aspect-Based Sentiment Analysis (ABSA) tasks aim to identify consumers' opinions about different aspects of products or services. BERT-based language models have been used successfully in applications that require a deep understanding of the language, such as sentiment analysis. This paper investigates the use of disentangled learning to improve BERT-based textual representations in ABSA tasks. Motivated by the success of disentangled representation learning in the field of computer vision, which aims to obtain explanatory factors of the data representations, we explored the recent DeBERTa model (Decoding-enhanced BERT with Disentangled Attention) to disentangle the syntactic and semantics features from a BERT architecture. Experimental results show that incorporating disentangled attention and a simple fine-tuning strategy for downstream tasks outperforms state-of-the-art models in ABSA's benchmark datasets.","url_abs":"https://research.latinxinai.org/papers/icml/2021/pdf/paper_28.pdf","url_pdf":"https://research.latinxinai.org/papers/icml/2021/pdf/paper_28.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"aspect-based-sentiment-analysis-using-bert","repo_url":"https://github.com/huberemanuel/ABSA-DeBERTa","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"aspect-based-sentiment-analysis-1","task_name":"Aspect-Based Sentiment Analysis"},{"task_slug":"aspect-based-sentiment-analysis","task_name":"Aspect-Based Sentiment Analysis (ABSA)"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"sentiment-analysis","task_name":"Sentiment Analysis"}],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bert","method_name":"BERT"},{"method_slug":"deberta","method_name":"DeBERTa"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-linear-decay","method_name":"Linear Warmup With Linear Decay"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"weight-decay","method_name":"Weight Decay"},{"method_slug":"wordpiece","method_name":"WordPiece"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/aspect-based-sentiment-analysis-on-semeval","task":"Aspect-Based Sentiment Analysis (ABSA)","dataset":"SemEval-2014 Task-4","model":"ABSA-DeBERTa","rank_in_archive_order":48,"of":48,"metrics":{"Laptop (Acc)":"82,76","Mean Acc (Restaurant + Laptop)":"86,11","Restaurant (Acc)":"89,46"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}