Browse State-of-the-Art › Automated Essay Scoring
Automated Essay Scoring
27 papers with code · 1 benchmark · 2 datasets archive 2025-07-28
Essay scoring: Automated Essay Scoring is the task of assigning a score to an essay, usually in the context of assessing the language ability of a language learner. The quality of an essay is affected by the following four primary dimensions: topic relevance, organization and coherence, word usage and sentence complexity, and grammar and mechanics.
Source: A Joint Model for Multimodal Document Quality Assessment
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| ASAP-AES (8 rows) | Neural Pairwise Contrastive Regression (NPCR) | Automated Essay Scoring via Pairwise Contrastive Regression | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 104 · with a code link: 27 · where Syntology ran a sample: 1 (1 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1 of 104 tagged: 1 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 104, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
23 Jan 2019 2 repositories listedCurrent state-of-art feature-engineered and end-to-end Automated Essay Score (AES) methods are proven to be unable to detect adversarial samples, e. g. the essays composed of permuted sentences and the prompt-irrelevant…
-
29 May 2024 1 repository listedWhile current Automated Essay Scoring (AES) methods demonstrate high scoring agreement with human raters, their decision-making mechanisms are not fully understood.
-
24 Apr 2024 1 repository listedWe evaluate both the AES performance that LLMs can achieve with prompting only and the helpfulness of the generated essay feedback.
-
13 Mar 2024 1 repository listedRecently, encoder-only pre-trained models such as BERT have been successfully applied in automated essay scoring (AES) to predict a single overall score.
-
10 Mar 2024 1 repository listedAlthough several methods were proposed to address the problem of automated essay scoring (AES) in the last 50 years, there is still much to desire in terms of effectiveness.
-
7 Feb 2024 1 repository listedWith an increasing focus in STEM education on critical thinking skills, science writing plays an ever more important role in curricula that stress inquiry skills.
-
12 Jan 2024 1 repository listedThrough extensive experiments with public and private datasets, we find that while LLMs do not surpass conventional state-of-the-art (SOTA) grading models in performance, they exhibit notable consistency…
-
11 Jan 2024 1 repository listedAutomatic Essay Scoring (AES) is a well-established educational pursuit that employs machine learning to evaluate student-authored essays.
-
30 Oct 2023 1 repository listedHowever, among users are trolls, who provide training examples with incorrect labels.
-
10 Jun 2023 1 repository listedCoherence is an important aspect of text quality, and various approaches have been applied to coherence modeling.
-
26 May 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Thus, predicting various trait scores of unseen-prompt essays (called cross-prompt essay trait scoring) is a remaining challenge of AES.
-
10 May 2023 1 repository listedHere, we propose WikiSQE, the first large-scale dataset for sentence quality estimation in Wikipedia.
-
28 Feb 2023 1 repository listedIn this study, we reproduce and compare state-of-the-art methods for AES in the Hindi domain.
-
1 Oct 2022 1 repository listedTo this end, in this paper we take inspiration from contrastive learning and propose a novel unified Neural Pairwise Contrastive Regression (NPCR) model in which both objectives are optimized simultaneously as a single…
-
8 May 2022 1 repository listedIn recent years, pre-trained models have become dominant in most natural language processing (NLP) tasks.
-
1 Nov 2021 1 repository listedIn this work, we first show that state-of-the-art systems, recent neural essay scoring systems, might be also influenced by the correlation between essay length and scores in a standard dataset.
-
13 Oct 2021 1 repository listedAutomated essay scoring (AES) is gaining increasing attention in the education sector as it significantly reduces the burden of manual scoring and allows ad hoc feedback for learners.
-
1 Aug 2021 1 repository listed“With the increasing popularity of learning Chinese as a second language (L2) the development of an automatic essay scoring (AES) method specially for Chinese L2 essays has become animportant task.
-
7 Apr 2021 1 repository listedAutomated text scoring (ATS) tasks, such as automated essay scoring and readability assessment, are important educational applications of natural language processing.
-
1 Feb 2021 1 repository listedTo find out which traits work best for different types of essays, we conduct ablation tests for each of the essay traits.
-
4 Aug 2020 1 repository listedCross-prompt automated essay scoring (AES) requires the system to use non target-prompt essays to award scores to a target-prompt essay.
-
14 Jul 2020 1 repository listedThis number is increasing further due to COVID-19 and the associated automation of education and testing.
-
18 Sep 2019 1 repository listedIn this paper, we present a new comparative study on automatic essay scoring (AES).
-
6 Aug 2019 1 repository listedThis paper presents an investigation of using a co-attention based neural network for source-dependent essay scoring.
-
18 Apr 2018 1 repository listedWe demonstrate that current state-of-the-art approaches to Automated Essay Scoring (AES) are not well-suited to capturing adversarially crafted input of grammatical but incoherent sequences of sentences.
-
14 Nov 2017 1 repository listedOur new method proposes a new SkipFlow mechanism that models relationships between snapshots of the hidden representations of a long short-term memory (LSTM) network as it reads.
-
1 Nov 2016 1 repository listed
-
Enhancing Marker Scoring Accuracy through Ordinal Confidence Modelling in Educational Assessments29 May 2025 0 repositories listedA key ethical challenge in Automated Essay Scoring (AES) is ensuring that scores are only released when they meet high reliability standards.
-
Automated Essay Scoring Incorporating Annotations from Automated Feedback Systems28 May 2025 0 repositories listedThis study illustrates how incorporating feedback-oriented annotations into the scoring pipeline can enhance the accuracy of automated essay scoring (AES).
-
Composable Cross-prompt Essay Scoring by Merging Models24 May 2025 0 repositories listedRecent advances in cross-prompt automated essay scoring (AES) typically train models jointly on all source prompts, often requiring additional access to unlabeled target prompt essays simultaneously.
-
CAFES: A Collaborative Multi-Agent Framework for Multi-Granular Multimodal Essay Scoring20 May 2025 0 repositories listed
-
TRATES: Trait-Specific Rubric-Assisted Cross-Prompt Essay Scoring20 May 2025 0 repositories listed
-
LCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Models13 May 2025 0 repositories listed
-
Do We Need a Detailed Rubric for Automated Essay Scoring using Large Language Models?2 May 2025 0 repositories listed
-
Does the Prompt-based Large Language Model Recognize Students' Demographics and Introduce Bias in Essay Scoring?30 Apr 2025 0 repositories listed
-
Evolution of AI in Education: Agentic Workflows25 Apr 2025 0 repositories listed
-
ARWI: Arabic Write and Improve16 Apr 2025 0 repositories listed
-
Enhancing Arabic Automated Essay Scoring with Synthetic Data and Error Injection22 Mar 2025 0 repositories listed
-
EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models17 Feb 2025 0 repositories listed
-
How well can LLMs Grade Essays in Arabic?27 Jan 2025 0 repositories listed
-
On the Suitability of pre-trained foundational LLMs for Analysis in German Legal Education20 Dec 2024 0 repositories listed
-
The Impact of Example Selection in Few-Shot Prompting on Automated Essay Scoring Using GPT Models28 Nov 2024 0 repositories listed
-
Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMs18 Oct 2024 0 repositories listed
-
Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards26 Sep 2024 0 repositories listed
-
Are Large Language Models Good Essay Graders?19 Sep 2024 0 repositories listed
-
Automated essay scoring in Arabic: a dataset and analysis of a BERT-based system15 Jul 2024 0 repositories listed
-
Is GPT-4 Alone Sufficient for Automated Essay Scoring?: A Comparative Judgment Approach Based on Rater Cognition8 Jul 2024 0 repositories listed
-
Automated Essay Scoring Using Grammatical Variety and Errors with Multi-Task Learning and Item Response Theory13 Jun 2024 0 repositories listed
-
Automatic Essay Multi-dimensional Scoring with Fine-tuning and Multiple Regression3 Jun 2024 0 repositories listed
-
Graded Relevance Scoring of Written Essays with Dense Retrieval8 May 2024 0 repositories listed
-
Can GPT-4 do L2 analytic assessment?29 Apr 2024 0 repositories listed
-
Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoring7 Apr 2024 0 repositories listed
-
Transformer-based Joint Modelling for Automatic Essay Scoring and Off-Topic Detection24 Mar 2024 0 repositories listed
-
Frustratingly Simple Prompting-based Text Denoising24 Feb 2024 0 repositories listed
-
DREsS: Dataset for Rubric-based Essay Scoring on EFL Writing21 Feb 2024 0 repositories listed
-
Empirical Study of Large Language Models as Automated Essay Scoring Tools in English Composition__Taking TOEFL Independent Writing Task for Example7 Jan 2024 0 repositories listed
-
Enhancing Essay Scoring with Adversarial Weights Perturbation and Metric-specific AttentionPooling6 Jan 2024 0 repositories listed
-
LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction8 Oct 2023 0 repositories listed
-
Rubric-Specific Approach to Automated Essay Scoring with Augmentation Training6 Sep 2023 0 repositories listed
-
Automated Essay Scoring in Argumentative Writing: DeBERTeachingAssistant9 Jul 2023 0 repositories listed
-
Review of feedback in Automated Essay Scoring9 Jul 2023 0 repositories listed
-
The Effectiveness of a Dynamic Loss Function in Neural Network Based Automated Essay Scoring15 May 2023 0 repositories listed
-
Can ChatGPT and Bard Generate Aligned Assessment Items? A Reliability Analysis against Human Performance9 Apr 2023 0 repositories listed
-
Using Active Learning Methods to Strategically Select Essays for Automated Scoring2 Jan 2023 0 repositories listed
-
Data Augmentation for Automated Essay Scoring using Transformer Models23 Oct 2022 0 repositories listed
-
Analytic Automated Essay Scoring Based on Deep Neural Networks Integrating Multidimensional Item Response Theory1 Oct 2022 0 repositories listed
-
MWE for Essay Scoring English as a Foreign Language1 Jun 2022 0 repositories listed
-
Improving Performance of Automated Essay Scoring by using back-translation essays and adjusted scores1 Mar 2022 0 repositories listed
-
Toward Educator-focused Automated Scoring Systems for Reading and Writing22 Dec 2021 0 repositories listed
-
Encoder Decoder Approach to Automated Essay Scoring For Deeper Semantic Analysis1 Dec 2021 0 repositories listed
-
The effects of data size on Automated Essay Scoring engines30 Aug 2021 0 repositories listed
-
Essay Quality Signals as Weak Supervision for Source-based Essay Scoring1 Apr 2021 0 repositories listed
-
Automated essay scoring using efficient transformer-based language models25 Feb 2021 0 repositories listed
-
Multi-task Learning for Automated Essay Scoring with Sentiment Analysis1 Dec 2020 0 repositories listed
-
Neural Automated Essay Scoring Incorporating Handcrafted Features1 Dec 2020 0 repositories listed
-
Centering-based Neural Coherence Modeling with Hierarchical Discourse Segments1 Nov 2020 0 repositories listed
-
Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking1 Nov 2020 0 repositories listed
-
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring13 Oct 2020 0 repositories listed
-
Automated Topical Component Extraction Using Neural Network Attention Scores from Source-based Essay Scoring4 Aug 2020 0 repositories listed
-
LinggleWrite: a Coaching System for Essay Writing1 Jul 2020 0 repositories listed
-
Multiple Instance Learning for Content Feedback Localization without Annotation1 Jul 2020 0 repositories listed
-
Should You Fine-Tune BERT for Automated Essay Scoring?1 Jul 2020 0 repositories listed
-
Automated Essay Scoring System for Nonnative Japanese Learners1 May 2020 0 repositories listed
-
Computing with Subjectivity Lexicons1 May 2020 0 repositories listed
-
UKARA 1.0 Challenge Track 1: Automatic Short-Answer Scoring in Bahasa Indonesia28 Feb 2020 0 repositories listed
-
Word Embedding for Response-To-Text Assessment of Evidence6 Aug 2019 0 repositories listed
-
Automated Essay Scoring with Discourse-Aware Neural Models1 Aug 2019 0 repositories listed
-
Equity Beyond Bias in Language Technologies for Education1 Aug 2019 0 repositories listed
-
Regression or classification? Automated Essay Scoring for Norwegian1 Aug 2019 0 repositories listed
-
Give Me More Feedback II: Annotating Thesis Strength and Related Attributes in Student Essays1 Jul 2019 0 repositories listed
-
Give Me More Feedback: Annotating Argument Persuasiveness and Related Attributes in Student Essays1 Jul 2018 0 repositories listed
-
TDNN: A Two-stage Deep Neural Network for Prompt-independent Automated Essay Scoring1 Jul 2018 0 repositories listed
-
Automated Essay Scoring in the Presence of Biased Ratings1 Jun 2018 0 repositories listed
-
21 Apr 2018 0 repositories listed
-
Neural Multi-task Learning in Automated Assessment21 Jan 2018 0 repositories listed
-
Investigating neural architectures for short answer scoring1 Sep 2017 0 repositories listed
-
Exploring Automated Essay Scoring for Nonnative English Speakers11 Jun 2017 0 repositories listed
-
1 Nov 2016 0 repositories listed
-
Constrained Multi-Task Learning for Automated Essay Scoring1 Aug 2016 0 repositories listed
-
1 Sep 2015 0 repositories listed
Syntology lines on 1 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections