Datasets › SemEval-2014 Task-4

SemEval-2014 Task-4

Introduced by Maria Pontiki et al. in SemEval-2014 Task 4: Aspect Based Sentiment Analysis1 Aug 2014 archive 2025-07-28

Sentiment analysis is increasingly viewed as a vital task both from an academic and a commercial standpoint. The majority of current approaches, however, attempt to detect the overall polarity of a sentence, paragraph, or text span, regardless of the entities mentioned (e.g., laptops, restaurants) and their aspects (e.g., battery, screen; food, service). By contrast, this task is concerned with aspect based sentiment analysis (ABSA), where the goal is to identify the aspects of given target entities and the sentiment expressed towards each aspect. Datasets consisting of customer reviews with human-authored annotations identifying the mentioned aspects of the target entities and the sentiment polarity of each aspect will be provided.

Subtask 2: Aspect term polarity

For a given set of aspect terms within a sentence, determine whether the polarity of each aspect term is positive, negative, neutral or conflict (i.e., both positive and negative).

For example:

“I loved their fajitas” → {fajitas: positive} “I hated their fajitas, but their salads were great” → {fajitas: negative, salads: positive} “The fajitas are their first plate” → {fajitas: neutral} “The fajitas were great to taste, but not to see” → {fajitas: conflict}

Benchmarks archive 2025-07-28

All 4 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Aspect-Based Sentiment Analysis (ABSA) SemEval-2014 Task-4 MT-ISA Mean Acc (Restaurant + Laptop) 89.21 Multi-Task Learning with LLMs for Implicit Sentiment... — 48 Compare
Aspect Extraction SemEval-2014 Task-4 InstructABSA Laptop (F1) 92.30 InstructABSA: Instruction Learning for Aspect Based... kevinscaria/instructabsa 6 Compare
Aspect-oriented Opinion Extraction SemEval-2014 Task-4 BARTABSA Restaurant 2014 (F1) 85.38 A Unified Generative Framework for Aspect-Based... yhcc/BARTABSA +2 5 Compare
Aspect Category Detection SemEval-2014 Task-4 pxp Average Recall 0.72 Latent Aspect Detection from Online Unsolicited Customer Reviews MohammadForouhesh/latent-aspect-detection 1 Compare

Papers archive 2025-07-28

30 shown of 52 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 107. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
Multi-Task Learning with LLMs for Implicit Sentiment Analysis: Data-level and Task-level Automatic Weight Learning 0 1 12 Dec 2024 not harvested
Masking The Bias : From Echo Chambers to Large Scale Aspect-Based Sentiment Analysis 1 1 2 Sep 2024 not harvested
RVISA: Reasoning and Verification for Implicit Sentiment Analysis 0 1 2 Jul 2024 not harvested
You Only Read Once: Constituency-Oriented Relational Graph Convolutional Network for Multi-Aspect Multi-Sentiment Classification 1 1 24 Mar 2024 not harvested
InstructABSA: Instruction Learning for Aspect Based Sentiment Analysis 1 2 16 Feb 2023 not harvested
Latent Aspect Detection from Online Unsolicited Customer Reviews 1 1 14 Apr 2022 not harvested
Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysis 1 1 14 Mar 2022 not harvested
LSA: Modeling Aspect Sentiment Coherency via Local Sentiment Aggregation 1 1 16 Oct 2021 not harvested
Understand me, if you refer to Aspect Knowledge: Knowledge-aware Gated Recurrent Memory Network 1 1 5 Aug 2021 not harvested
Aspect-based Sentiment Analysis using BERT with Disentangled Attention 1 1 18 Jul 2021 not harvested
A Unified Generative Framework for Aspect-Based Sentiment Analysis 3 1 8 Jun 2021 not harvested
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa 1 1 11 Apr 2021 not harvested
A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis 0 1 4 Jan 2021 not harvested
Does BERT Understand Sentiment? Leveraging Comparisons Between Contextual and Non-Contextual Embeddings to Improve Aspect-Based Sentiment Models 0 1 23 Nov 2020 not harvested
Introducing Syntactic Structures into Target Opinion Word Extraction with Deep Learning 0 1 26 Oct 2020 not harvested
Improving BERT Performance for Aspect-Based Sentiment Analysis 2 2 22 Oct 2020 ran 5 of 11 samples (6 unverified)
Automated Concatenation of Embeddings for Structured Prediction 2 1 10 Oct 2020 not harvested
Aspect Based Sentiment Analysis with Aspect-Specific Opinion Spans 1 1 6 Oct 2020 not harvested
Don't Eclipse Your Arts Due to Small Discrepancies: Boundary Repositioning with a Pointer Network for Aspect Extraction 0 1 1 Jul 2020 not harvested
Investigating Typed Syntactic Dependencies for Targeted Sentiment Classification Using Graph Attention Neural Network 1 1 22 Feb 2020 not harvested
Adversarial Training for Aspect-Based Sentiment Analysis with BERT 4 2 30 Jan 2020 not harvested
Latent Opinions Transfer Network for Target-Oriented Opinion Words Extraction 1 1 7 Jan 2020 not harvested
A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extraction 6 1 17 Dec 2019 not harvested
Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classification 0 1 13 Sep 2019 not harvested
Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification 3 1 30 Aug 2019 ran 0 of 7 samples (7 unverified)
Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis 1 2 1 Jul 2019 not harvested
An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis 3 1 17 Jun 2019 not harvested
Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-level Sentiment Classification 1 1 11 Jun 2019 not harvested
Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis 1 1 4 Jun 2019 not harvested
Target-oriented Opinion Words Extraction with Target-fused Neural Sequence Labeling 1 1 1 Jun 2019 not harvested

The full list of 52 is in the JSON twin.

Dataset loaders archive 2025-07-28

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

Variants archive 2025-07-28

  • SemEval-2014 Task-4

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections