{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/attention-and-lexicon-regularized-lstm-for","title":"Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis","arxiv_id":null,"date":"2019-07-01","proceeding":"ACL 2019 7","authors":["Lingxian Bao","Patrik Lambert","Toni Badia"],"abstract":"Abstract Attention based deep learning systems have been demonstrated to be the state of the art approach for aspect-level sentiment analysis, however, end-to-end deep neural networks lack flexibility as one can not easily adjust the network to fix an obvious problem, especially when more training data is not available: e.g. when it always predicts \\textit{positive} when seeing the word \\textit{disappointed}. Meanwhile, it is less stressed that attention mechanism is likely to {``}over-focus{''} on particular parts of a sentence, while ignoring positions which provide key information for judging the polarity. In this paper, we describe a simple yet effective approach to leverage lexicon information so that the model becomes more flexible and robust. We also explore the effect of regularizing attention vectors to allow the network to have a broader {``}focus{''} on different parts of the sentence. The experimental results demonstrate the effectiveness of our approach.","url_abs":"https://aclanthology.org/P19-2035","url_pdf":"https://aclanthology.org/P19-2035.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"attention-and-lexicon-regularized-lstm-for","repo_url":"https://github.com/LingxB/atlx","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[{"task_slug":"aspect-based-sentiment-analysis-1","task_name":"Aspect-Based Sentiment Analysis"},{"task_slug":"aspect-based-sentiment-analysis","task_name":"Aspect-Based Sentiment Analysis (ABSA)"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"sentiment-analysis","task_name":"Sentiment Analysis"}],"methods":[{"method_slug":"lstm","method_name":"LSTM"},{"method_slug":"single-headed-attention","method_name":"Single-Headed Attention"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/aspect-based-sentiment-analysis-on-semeval","task":"Aspect-Based Sentiment Analysis (ABSA)","dataset":"SemEval-2014 Task-4","model":"ATLX-Ent","rank_in_archive_order":45,"of":48,"metrics":{"Restaurant (Acc)":"82.86"},"uses_additional_data":false},{"leaderboard":"/sota/aspect-based-sentiment-analysis-on-semeval","task":"Aspect-Based Sentiment Analysis (ABSA)","dataset":"SemEval-2014 Task-4","model":"ATLX","rank_in_archive_order":46,"of":48,"metrics":{"Restaurant (Acc)":"82.62"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}