LLM real-life tasks

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

9 shown of 9 papers with code (9 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• mAIstro: an open-source multi-agentic system for automated end-to-end development of radiomics and deep learning models for medical imaging
  30 Apr 2025 1 repository listed
  Agentic systems built on large language models (LLMs) offer promising capabilities for automating complex workflows in healthcare AI.
• Affordable AI Assistants with Knowledge Graph of Thoughts
  3 Apr 2025 1 repository listed
  Such structured representation of task-relevant knowledge enables low-cost models to solve complex tasks effectively.
• MyGO Multiplex CoT: A Method for Self-Reflection in Large Language Models via Double Chain of Thought Thinking
  20 Jan 2025 1 repository listed
  Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks.
• Using Instruction-Tuned Large Language Models to Identify Indicators of Vulnerability in Police Incident Narratives
  16 Dec 2024 1 repository listed
  We explore multiple prompting strategies and model sizes, and the variability of labels generated by repeated prompts.
• WebCanvas: Benchmarking Web Agents in Online Environments
  18 Jun 2024 1 repository listed Syntology ran 1 of 2 samples · 1 unverified
  To bridge this gap, we introduce WebCanvas, an innovative online evaluation framework for web agents that effectively addresses the dynamic nature of web interactions.
• AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
  2 Mar 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified
  In this paper, we propose AutoDefense, a multi-agent defense framework that filters harmful responses from LLMs.
• ITINERA: Integrating Spatial Optimization with Large Language Models for Open-domain Urban Itinerary Planning
  11 Feb 2024 1 repository listed Syntology ran 8 of 8 samples · 0 unverified · 8 pointer-only (licence)
  Citywalk, a recently popular form of urban travel, requires genuine personalization and understanding of fine-grained requests compared to traditional itinerary planning.
• CloudEval-YAML: A Practical Benchmark for Cloud Configuration Generation
  10 Nov 2023 1 repository listed
  We develop the CloudEval-YAML benchmark with practicality in mind: the dataset consists of hand-written problems with unit tests targeting practical scenarios.
• LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents
  9 Nov 2023 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 1 pointer-only (licence)
  LLaVA-Plus is a general-purpose multimodal assistant that expands the capabilities of large multimodal models.

Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.