{"url":"/task/automated-essay-scoring","name":"Automated Essay Scoring","slug":"automated-essay-scoring","description_markdown":"Essay scoring: **Automated Essay Scoring** is the task of assigning a score to an essay, usually in the context of assessing the language ability of a language learner. The quality of an essay is affected by the following four primary dimensions: topic relevance, organization and coherence, word usage and sentence complexity, and grammar and mechanics.\r\n\r\n\r\n<span class=\"description-source\">Source: [A Joint Model for Multimodal Document Quality Assessment ](https://arxiv.org/abs/1901.01010)</span>","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":104,"papers_with_code":27,"benchmarks":1,"benchmark_tables_in_archive":1,"benchmark_tables_shown":1,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":2,"subtasks":0,"parent_tasks":0},"benchmarks":[{"leaderboard":"/sota/automated-essay-scoring-on-asap","slug":"automated-essay-scoring-on-asap","dataset":"ASAP-AES","dataset_url":"/dataset/asap","rows_in_archive":8,"metrics":["Quadratic Weighted Kappa"],"first_row_in_archive_order":{"model":"Neural Pairwise Contrastive Regression (NPCR)","paper_title":"Automated Essay Scoring via Pairwise Contrastive Regression","paper_url":"/paper/automated-essay-scoring-via-pairwise","paper_date":"","arxiv_id":null,"code_links":[{"title":"carryckw/aes-npcr","url":"https://github.com/carryckw/aes-npcr"}],"syntology":null}}],"datasets":[{"url":"/dataset/asap","name":"ASAP-AES","full_name":"Automated Student Assessment Prize","num_papers_in_archive":11},{"url":"/dataset/the-write-improve-corpus-2024","name":"The Write & Improve Corpus 2024","full_name":"","num_papers_in_archive":1}],"subtasks":[],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (desc), then date (desc); the archive holds no stars","population":"papers tagged with this task that list at least one repository in the archive","shown":27,"of":27,"tagged_in_all":104,"items":[{"url":"/paper/automated-essay-scoring-based-on-two-stage","title":"Automated Essay Scoring based on Two-Stage Learning","date":"2019-01-23","arxiv_id":"1901.07744","repositories_listed":2,"syntology":null},{"url":"/paper/beyond-agreement-diagnosing-the-rationale","title":"Beyond Agreement: Diagnosing the Rationale Alignment of Automated Essay Scoring Methods based on Linguistically-informed Counterfactuals","date":"2024-05-29","arxiv_id":"2405.19433","repositories_listed":1,"syntology":null},{"url":"/paper/exploring-llm-prompting-strategies-for-joint","title":"Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation","date":"2024-04-24","arxiv_id":"2404.15845","repositories_listed":1,"syntology":null},{"url":"/paper/autoregressive-score-generation-for-multi","title":"Autoregressive Score Generation for Multi-trait Essay Scoring","date":"2024-03-13","arxiv_id":"2403.08332","repositories_listed":1,"syntology":null},{"url":"/paper/can-large-language-models-automatically-score","title":"Can Large Language Models Automatically Score Proficiency of Written Essays?","date":"2024-03-10","arxiv_id":"2403.06149","repositories_listed":1,"syntology":null},{"url":"/paper/veras-verify-then-assess-stem-lab-reports","title":"VerAs: Verify then Assess STEM Lab Reports","date":"2024-02-07","arxiv_id":"2402.05224","repositories_listed":1,"syntology":null},{"url":"/paper/from-automation-to-augmentation-large","title":"Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs","date":"2024-01-12","arxiv_id":"2401.06431","repositories_listed":1,"syntology":null},{"url":"/paper/unveiling-the-tapestry-of-automated-essay","title":"Unveiling the Tapestry of Automated Essay Scoring: A Comprehensive Investigation of Accuracy, Fairness, and Generalizability","date":"2024-01-11","arxiv_id":"2401.05655","repositories_listed":1,"syntology":null},{"url":"/paper/learning-to-love-diligent-trolls-accounting","title":"Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task","date":"2023-10-30","arxiv_id":"2310.19271","repositories_listed":1,"syntology":null},{"url":"/paper/modeling-structural-similarities-between","title":"Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks","date":"2023-06-10","arxiv_id":"2306.06472","repositories_listed":1,"syntology":null},{"url":"/paper/prompt-and-trait-relation-aware-cross-prompt","title":"Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring","date":"2023-05-26","arxiv_id":"2305.16826","repositories_listed":1,"syntology":{"n":6,"n_ran":0,"n_unverified":6,"n_pointer_only":0}},{"url":"/paper/wikisqe-a-large-scale-dataset-for-sentence","title":"WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia","date":"2023-05-10","arxiv_id":"2305.05928","repositories_listed":1,"syntology":null},{"url":"/paper/h-aes-towards-automated-essay-scoring-for","title":"H-AES: Towards Automated Essay Scoring for Hindi","date":"2023-02-28","arxiv_id":"2302.14635","repositories_listed":1,"syntology":null},{"url":"/paper/automated-essay-scoring-via-pairwise","title":"Automated Essay Scoring via Pairwise Contrastive Regression","date":"2022-10-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/on-the-use-of-bert-for-automated-essay","title":"On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation","date":"2022-05-08","arxiv_id":"2205.03835","repositories_listed":1,"syntology":null},{"url":"/paper/countering-the-influence-of-essay-length-in","title":"Countering the Influence of Essay Length in Neural Essay Scoring","date":"2021-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/automated-essay-scoring-using-transformer","title":"Automated Essay Scoring Using Transformer Models","date":"2021-10-13","arxiv_id":"2110.06874","repositories_listed":1,"syntology":null},{"url":"/paper/a-prompt-independent-and-interpretable","title":"A Prompt-independent and Interpretable Automated Essay Scoring Method for Chinese Second Language Writing","date":"2021-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/expats-a-toolkit-for-explainable-automated","title":"EXPATS: A Toolkit for Explainable Automated Text Scoring","date":"2021-04-07","arxiv_id":"2104.03364","repositories_listed":1,"syntology":null},{"url":"/paper/many-hands-make-light-work-using-essay-traits","title":"Many Hands Make Light Work: Using Essay Traits to Automatically Score Essays","date":"2021-02-01","arxiv_id":"2102.00781","repositories_listed":1,"syntology":null},{"url":"/paper/prompt-agnostic-essay-scorer-a-domain","title":"Prompt Agnostic Essay Scorer: A Domain Generalization Approach to Cross-prompt Automated Essay Scoring","date":"2020-08-04","arxiv_id":"2008.01441","repositories_listed":1,"syntology":null},{"url":"/paper/calling-out-bluff-attacking-the-robustness-of","title":"Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems","date":"2020-07-14","arxiv_id":"2007.06796","repositories_listed":1,"syntology":null},{"url":"/paper/language-models-and-automated-essay-scoring","title":"Language models and Automated Essay Scoring","date":"2019-09-18","arxiv_id":"1909.09482","repositories_listed":1,"syntology":null},{"url":"/paper/co-attention-based-neural-network-for-source-2","title":"Co-Attention Based Neural Network for Source-Dependent Essay Scoring","date":"2019-08-06","arxiv_id":"1908.01993","repositories_listed":1,"syntology":null},{"url":"/paper/neural-automated-essay-scoring-and-coherence","title":"Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Input","date":"2018-04-18","arxiv_id":"1804.06898","repositories_listed":1,"syntology":null},{"url":"/paper/skipflow-incorporating-neural-coherence","title":"SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring","date":"2017-11-14","arxiv_id":"1711.04981","repositories_listed":1,"syntology":null},{"url":"/paper/a-neural-approach-to-automated-essay-scoring","title":"A Neural Approach to Automated Essay Scoring","date":"2016-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null}],"syntology_records":1,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-09-24T18:15:14+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; our fixture could not drive it","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"}},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"}}