World Knowledge

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

2 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 358 papers with code (818 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Direct Preference Optimization: Your Language Model is Secretly a Reward Model
  29 May 2023 29 repositories listed Syntology ran 6 of 31 samples · 25 unverified · 2 pointer-only (licence)
  Existing methods for gaining such steerability collect human labels of the relative quality of model generations and fine-tune the unsupervised LM to align with these preferences, often with reinforcement learning from…
• Measuring Massive Multitask Language Understanding
  7 Sep 2020 18 repositories listed Syntology ran 5 of 26 samples · 21 unverified · 1 pointer-only (licence)
  By comprehensively evaluating the breadth and depth of a model's academic and professional understanding, our test can be used to analyze models across many tasks and to identify important shortcomings.
• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  22 May 2020 18 repositories listed Syntology ran 4 of 6 samples · 2 unverified
  Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks.
• Mistral 7B
  10 Oct 2023 6 repositories listed Syntology ran 9 of 11 samples · 2 unverified · 1 pointer-only (licence)
  We introduce Mistral 7B v0.
• REALM: Retrieval-Augmented Language Model Pre-Training
  10 Feb 2020 6 repositories listed Syntology ran 4 of 4 samples · 0 unverified
  Language model pre-training has been shown to capture a surprising amount of world knowledge, crucial for NLP tasks such as question answering.
• Imagine This! Scripts to Compositions to Videos
  10 Apr 2018 5 repositories listed
  Imagining a scene described in natural language with realistic layout and appearance of entities is the ultimate test of spatial, visual, and semantic world knowledge.
• Scaling Synthetic Data Creation with 1,000,000,000 Personas
  28 Jun 2024 4 repositories listed Syntology ran 1 of 4 samples · 3 unverified · 1 pointer-only (licence)
  We propose a novel persona-driven data synthesis methodology that leverages various perspectives within a large language model (LLM) to create diverse synthetic data.
• MEIM: Multi-partition Embedding Interaction Beyond Block Term Format for Efficient and Expressive Link Prediction
  30 Sep 2022 4 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  Knowledge graph embedding aims to predict the missing relations between entities in knowledge graphs.
• CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge
  2 Nov 2018 4 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  To investigate question answering with prior knowledge, we present CommonsenseQA: a challenging new dataset for commonsense question answering.
• VILA: On Pre-training for Visual Language Models
  12 Dec 2023 3 repositories listed
  Visual language models (VLMs) rapidly progressed with the recent success of large language models.
• Dense X Retrieval: What Retrieval Granularity Should We Use?
  11 Dec 2023 3 repositories listed
  We discover that the retrieval unit choice significantly impacts the performance of both retrieval and downstream tasks.
• Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models
  15 Nov 2023 3 repositories listed
  Although Large Language Models (LLMs) demonstrate remarkable ability in processing and generating human-like text, they do have limitations when it comes to comprehending and expressing world knowledge that extends…
• Aligning AI With Shared Human Values
  5 Aug 2020 3 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  We show how to assess a language model's knowledge of basic concepts of morality.
• ASER: A Large-scale Eventuality Knowledge Graph
  1 May 2019 3 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  Understanding human's language requires complex world knowledge.
• WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
  10 Mar 2025 2 repositories listed Syntology ran 5 of 5 samples · 0 unverified · 5 pointer-only (licence)
  Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content.
• BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principle
  22 Feb 2025 2 repositories listed
  Humor is prevalent in online communications and it often relies on more than one modality (e.
• SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languages
  29 Jul 2024 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  Large Language Models (LLMs) have shown remarkable abilities across various tasks, yet their development has predominantly centered on high-resource languages like English and Chinese, leaving low-resource languages…
• VISA: Reasoning Video Object Segmentation via Large Language Models
  16 Jul 2024 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  In this paper, we introduce a new task, Reasoning Video Object Segmentation (ReasonVOS).
• A Synthetic Dataset for Personal Attribute Inference
  11 Jun 2024 2 repositories listed Syntology ran 5 of 6 samples · 1 unverified
  Recently, powerful Large Language Models (LLMs) have become easily accessible to hundreds of millions of users world-wide.
• Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models
  15 May 2024 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  We present Elements of World Knowledge (EWOK), a framework for evaluating world modeling in language models by testing their ability to use knowledge of a concept to match a target text with a plausible/implausible…
• Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representation
  15 Apr 2024 2 repositories listed
  To further augment the multi-modal representations, MyGO incorporates fine-grained contrastive learning to highlight the specificity of the entity representations.
• Can LLMs' Tuning Methods Work in Medical Multimodal Domain?
  11 Mar 2024 2 repositories listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  In this paper, we delve into the fine-tuning methods of LLMs and conduct extensive experiments to investigate the impact of fine-tuning methods for large models on the existing multimodal model in the medical domain…
• GRILLBot In Practice: Lessons and Tradeoffs Deploying Large Language Models for Adaptable Conversational Task Assistants
  12 Feb 2024 2 repositories listed
  We tackle the challenge of building real-world multimodal assistants for complex real-world tasks.
• Bring Your Own KG: Self-Supervised Program Synthesis for Zero-Shot KGQA
  14 Nov 2023 2 repositories listed
  We present BYOKG, a universal question-answering (QA) system that can operate on any knowledge graph (KG), requires no human-annotated training data, and can be ready to use within a day -- attributes that are…
• FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
  5 Oct 2023 2 repositories listed
  Specifically, we introduce FreshQA, a novel dynamic QA benchmark encompassing a diverse range of question and answer types, including questions that require fast-changing world knowledge as well as questions with false…
• Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversations
  23 Aug 2023 2 repositories listed
  We introduce Topical-Chat, a knowledge-grounded human-human conversation dataset where the underlying knowledge spans 8 broad topics and conversation partners don't have explicitly defined roles, to help further…
• ExpeL: LLM Agents Are Experiential Learners
  20 Aug 2023 2 repositories listed Syntology ran 6 of 8 samples · 2 unverified
  The recent surge in research interest in applying large language models (LLMs) to decision-making tasks has flourished by leveraging the extensive world knowledge embedded in LLMs.
• LISA: Reasoning Segmentation via Large Language Model
  1 Aug 2023 2 repositories listed
  In this work, we propose a new segmentation task -- reasoning segmentation.
• PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model
  2 Apr 2023 2 repositories listed
  In the research of end-to-end dialogue systems, using real-world knowledge to generate natural, fluent, and human-like utterances with correct answers is crucial.
• Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
  22 Jun 2022 2 repositories listed Syntology ran 3 of 9 samples · 6 unverified · 3 pointer-only (licence)
  We present the Pathways Autoregressive Text-to-Image (Parti) model, which generates high-fidelity photorealistic images and supports content-rich synthesis involving complex compositions and world knowledge.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.