Papers › Multi-Task Learning with LLMs for Implicit Sentiment Analysis: Data-level and...

Multi-Task Learning with LLMs for Implicit Sentiment Analysis: Data-level and Task-level Automatic Weight Learning

12 Dec 2024arXiv:2412.09046archive 2025-07-28

Wenna Lai, Haoran Xie, Guandong Xu, Qing Li

Implicit sentiment analysis (ISA) presents significant challenges due to the absence of salient cue words. Previous methods have struggled with insufficient data and limited reasoning capabilities to infer underlying opinions. Integrating multi-task learning (MTL) with large language models (LLMs) offers the potential to enable models of varying sizes to reliably perceive and recognize genuine opinions in ISA. However, existing MTL approaches are constrained by two sources of uncertainty: data-level uncertainty, arising from hallucination problems in LLM-generated contextual information, and task-level uncertainty, stemming from the varying capacities of models to process contextual information. To handle these uncertainties, we introduce MT-ISA, a novel MTL framework that enhances ISA by leveraging the generation and reasoning capabilities of LLMs through automatic MTL. Specifically, MT-ISA constructs auxiliary tasks using generative LLMs to supplement sentiment elements and incorporates automatic MTL to fully exploit auxiliary data. We introduce data-level and task-level automatic weight learning (AWL), which dynamically identifies relationships and prioritizes more reliable data and critical tasks, enabling models of varying sizes to adaptively learn fine-grained weights based on their reasoning capabilities. We investigate three strategies for data-level AWL, while also introducing homoscedastic uncertainty for task-level AWL. Extensive experiments reveal that models of varying sizes achieve an optimal balance between primary prediction and auxiliary tasks in MT-ISA. This underscores the effectiveness and adaptability of our approach.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Aspect-Based Sentiment Analysis (ABSA)HallucinationMulti-Task LearningSentiment Analysis

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Aspect-Based Sentiment Analysis (ABSA) SemEval-2014 Task-4 MT-ISA Laptop (Acc) 85.74 #1 of 48 Archive leaderboard report
Aspect-Based Sentiment Analysis (ABSA) SemEval-2014 Task-4 MT-ISA Mean Acc (Restaurant + Laptop) 89.21 #1 of 48 Archive leaderboard report
Aspect-Based Sentiment Analysis (ABSA) SemEval-2014 Task-4 MT-ISA Restaurant (Acc) 92.68 #1 of 48 Archive leaderboard report
Sentiment Analysis SemEval MT-ISAO (Ours) F1-score 0.9268 #1 of 2 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections