Ethics

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

4 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 100 papers with code (832 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Ego4D: Around the World in 3,000 Hours of Egocentric Video
  13 Oct 2021 8 repositories listed Syntology ran 4 of 15 samples · 11 unverified · 2 pointer-only (licence)
  We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite.
• Scaling Language Models: Methods, Analysis & Insights from Training Gopher
  8 Dec 2021 3 repositories listed
  Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world.
• Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis
  17 Sep 2021 3 repositories listed
  The objective of the sheet is to facilitate and encourage more thoughtfulness on why to automate, how to automate, and how to judge success well before the building of AER systems.
• Ethics Sheets for AI Tasks
  2 Jul 2021 3 repositories listed
  I will also present a template for ethics sheets with 50 ethical considerations, using the task of emotion recognition as a running example.
• Aligning AI With Shared Human Values
  5 Aug 2020 3 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  We show how to assess a language model's knowledge of basic concepts of morality.
• Language Model Alignment in Multilingual Trolley Problems
  2 Jul 2024 2 repositories listed Syntology ran 3 of 4 samples · 1 unverified
  We evaluate the moral alignment of large language models (LLMs) with human preferences in multilingual trolley problems.
• JailbreakRadar: Comprehensive Assessment of Jailbreak Attacks Against LLMs
  8 Feb 2024 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  Jailbreak attacks aim to bypass the LLMs' safeguards.
• TrustLLM: Trustworthiness in Large Language Models
  10 Jan 2024 2 repositories listed
  This paper introduces TrustLLM, a comprehensive study of trustworthiness in LLMs, including principles for different dimensions of trustworthiness, established benchmark, evaluation, and analysis of trustworthiness for…
• AI for Global Climate Cooperation: Modeling Global Climate Negotiations, Agreements, and Long-Term Cooperation in RICE-N
  15 Aug 2022 2 repositories listed
  To facilitate this research, here we introduce RICE-N, a multi-region integrated assessment model that simulates the global climate and economy, and which can be used to design and evaluate the strategic outcomes for…
• Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicity
  14 Mar 2022 2 repositories listed
  While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences.
• When Ethics and Payoffs Diverge: LLM Agents in Morally Charged Social Dilemmas
  25 May 2025 1 repository listed Syntology ran 2 of 13 samples · 11 unverified
  Recent advances in large language models (LLMs) have enabled their use in complex agentic roles, involving decision-making with humans or other agents, making ethical alignment a key AI safety concern.
• HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluation
  16 May 2025 1 repository listed
  Large multimodal models (LMMs) now excel on many vision language benchmarks, however, they still struggle with human centered criteria such as fairness, ethics, empathy, and inclusivity, key to aligning with human…
• Achieving Distributive Justice in Federated Learning via Uncertainty Quantification
  22 Apr 2025 1 repository listed
  In this work, we propose UDJ-FL (Uncertainty-based Distributive Justice for Federated Learning), a flexible federated learning framework that can achieve multiple distributive justice-based client-level fairness metrics.
• Surveying Professional Writers on AI: Limitations, Expectations, and Fears
  7 Apr 2025 1 repository listed
  The rapid development of AI-driven tools, particularly large language models (LLMs), is reshaping professional writing.
• Analyzing the Safety of Japanese Large Language Models in Stereotype-Triggering Prompts
  3 Mar 2025 1 repository listed
  In recent years, Large Language Models have attracted growing interest for their significant potential, though concerns have rapidly emerged regarding unsafe behaviors stemming from inherent stereotypes and biases.
• Toward Robust Non-Transferable Learning: A Survey and Benchmark
  19 Feb 2025 1 repository listed
  While numerous methods have been proposed in this field, a comprehensive review of existing progress and a thorough analysis of current limitations remain lacking.
• The Odyssey of the Fittest: Can Agents Survive and Still Be Good?
  8 Feb 2025 1 repository listed
  Surprisingly, the GPT 4o agent outperformed the Bayesian models in both survival and ethical consistency, challenging assumptions about traditional probabilistic methods and raising a new challenge to understand the…
• ApplE: An Applied Ethics Ontology with Event Context
  7 Feb 2025 1 repository listed
  To achieve this, we propose ApplE, an Applied Ethics ontology that captures philosophical theory and event context to holistically describe the morality of an action.
• Bias in Decision-Making for AI's Ethical Dilemmas: A Comparative Study of ChatGPT and Claude
  17 Jan 2025 1 repository listed
  Our study contributes to the growing body of research on AI ethics by providing a systematic framework for evaluating protected attributes in LLMs' ethical decision-making capabilities.
• Visual Large Language Models for Generalized and Specialized Applications
  6 Jan 2025 1 repository listed
  Visual-language models (VLM) have emerged as a powerful tool for learning a unified embedding space for vision and language.
• The Only Way is Ethics: A Guide to Ethical Research with Large Language Models
  20 Dec 2024 1 repository listed
  'LLM Ethics Whitepaper' distils a thorough literature review into clear Do's and Don'ts, which we present also in this paper.
• A History of Philosophy in Colombia through Topic Modelling
  5 Dec 2024 1 repository listed
  By analyzing the evolution of topics across the journal's history, we identify various trends and specific dynamics in philosophical discourse within the Colombian and Latin American context.
• Progressive Generalization Risk Reduction for Data-Efficient Causal Effect Estimation
  18 Nov 2024 1 repository listed
  Causal effect estimation (CEE) provides a crucial tool for predicting the unobserved counterfactual outcome for an entity.
• Unveiling Large Language Models Generated Texts: A Multi-Level Fine-Grained Detection Framework
  18 Oct 2024 1 repository listed
  Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement.
• Data Defenses Against Large Language Models
  17 Oct 2024 1 repository listed
  Large language models excel at performing inference over text to extract information, summarize information, or generate additional text.
• Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models
  17 Oct 2024 1 repository listed
  This whitepaper offers an overview of the ethical considerations surrounding research into or with large language models (LLMs).
• On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook
  11 Oct 2024 1 repository listed
  In this context, we present a survey on natural language processing (NLP) approaches to modeling depression in social media, providing the reader with a post-COVID-19 outlook.
• TRIAGE: Ethical Benchmarking of AI Models Through Mass Casualty Simulations
  10 Oct 2024 1 repository listed
  We present the TRIAGE Benchmark, a novel machine ethics (ME) benchmark that tests LLMs' ability to make ethical decisions during mass casualty incidents.
• XTRUST: On the Multilingual Trustworthiness of Large Language Models
  24 Sep 2024 1 repository listed
  Large language models (LLMs) have demonstrated remarkable capabilities across a range of natural language processing (NLP) tasks, capturing the attention of both practitioners and the broader public.
• RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaboration
  23 Sep 2024 1 repository listed
  Then, RAM2C organizes LLMs, which are retrieval-augmented by the above different knowledge bases, into multi-experts groups with distinct roles to generate the HTS-compliant educational dialogues dataset.

Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.