Preference Mapping

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

9 shown of 9 papers with code (11 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Learning Transferable Visual Models From Natural Language Supervision
  26 Feb 2021 82 repositories listed Syntology ran 16 of 20 samples · 4 unverified · 16 pointer-only (licence)
  State-of-the-art computer vision systems are trained to predict a fixed set of predetermined object categories.
• Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  29 May 2023 29 repositories listed Syntology ran 6 of 31 samples · 25 unverified · 2 pointer-only (licence)
  Existing methods for gaining such steerability collect human labels of the relative quality of model generations and fine-tune the unsupervised LM to align with these preferences, often with reinforcement learning from…
• LAION-5B: An open large-scale dataset for training next generation image-text models
  16 Oct 2022 5 repositories listed Syntology ran 4 of 18 samples · 14 unverified · 3 pointer-only (licence)
  We show successful replication and fine-tuning of foundational models like CLIP, GLIDE and Stable Diffusion using the dataset, and discuss further experiments enabled with an openly available dataset of this scale.
• ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation
  12 Apr 2023 3 repositories listed Syntology ran 3 of 12 samples · 9 unverified · 2 pointer-only (licence)
  We present a comprehensive solution to learn and improve text-to-image models from human preference feedback.
• PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences
  12 Jun 2024 1 repository listed Syntology ran 2 of 4 samples · 2 unverified
  We propose using the ideal point model as a lens to view alignment using preference comparisons.
• Personalized Language Modeling from Personalized Human Feedback
  6 Feb 2024 1 repository listed Syntology ran 8 of 9 samples · 1 unverified
  While Reinforcement Learning from Human Feedback (RLHF) is a commonly used framework for aligning LLMs with human preferences, vanilla RLHF assumes that all human preferences share the same distribution, preventing…
• Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
  15 Jun 2023 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  By fine-tuning CLIP on HPD v2, we obtain Human Preference Score v2 (HPS v2), a scoring model that can more accurately predict human preferences on generated images.
• Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation
  2 May 2023 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  Using this web app we build Pick-a-Pic, a large, open dataset of text-to-image prompts and real users' preferences over generated images.
• PAI-BPR: Personalized Outfit Recommendation Scheme with Attribute-wise Interpretability
  4 Aug 2020 1 repository listed
  The rise in the fashion industry and its effect on social influencing have made outfit compatibility a need.

Syntology lines on 8 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.