{"url":"/dataset/among-them","name":"Among Them","full_name":"Among Them dialogs and persuasion labels","description_markdown":"The dataset contains dialogs of different LLMs from the discussion phase of a text-based Among Us-like game. The phrases in the dataset were annotated according to 25 selected persuasion techniques: Appeal to Logic, Appeal to Emotion, Appeal to Credibility, Shifting the Burden of Proof, Bandwagon Effect, Distraction, Gaslighting, Appeal to Urgency, Deception, Lying, Feigning Ignorance, Vagueness, Minimization, Self-Deprecation, Projection, Appeal to Relationship, Humor, Sarcasm, Withholding Information, Exaggeration, Denial without Evidence, Strategic Voting Suggestion, Appeal to Rules, Confirmation Bias Exploitation, Information Overload. The annotation was performed automatically by few-shot prompting a Gemini Flash 1.5 model with a temperature of 0. On a random sample of 11 games involving a total of 509 persuasion tags, Krippendorff's alpha inter-rater agreement between human annotations and the persuasion tagger was 0.56. For the definitions of the persuasion techniques, please refer to the associated publication: Among Them: A game-based framework for assessing persuasion capabilities of LLMs.","description_withheld":null,"homepage":"https://doi.org/10.5281/zenodo.14935395","introduced_date":"2025-02-27","introduced_date_note":null,"introduced_by":{"paper":"/paper/among-them-a-game-based-framework-for","title":"Among Them: A game-based framework for assessing persuasion capabilities of LLMs","first_author":"Mateusz Idziejczak","url":null},"license":{"name":"CC-BY","url":"https://creativecommons.org/licenses/by/4.0/legalcode"},"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Persuasion Strategies","url":"/task/persuasion-strategies","datasets_with_task":"/datasets/task/persuasion-strategies"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["Among Them"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers_with_a_benchmark_row":[],"syntology_totals":{"read_at":"2026-09-24T18:15:14+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"note":"the per-paper counts above, summed; not a rate"},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks."}