Task 2

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 154 papers with code (572 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• SimMIM: A Simple Framework for Masked Image Modeling
  18 Nov 2021 7 repositories listed Syntology ran 9 of 14 samples · 5 unverified
  We also leverage this approach to facilitate the training of a 3B model (SwinV2-G), that by 40× less data than that in previous practice, we achieve the state-of-the-art on four representative vision benchmarks.
• Data Shapley: Equitable Valuation of Data for Machine Learning
  5 Apr 2019 6 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  As data becomes the fuel driving technological and economic growth, a fundamental challenge is how to quantify the value of data in algorithmic predictions and decisions.
• MIMII DUE: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection with Domain Shifts due to Changes in Operational and Environmental Conditions
  6 May 2021 5 repositories listed
  In this paper, we introduce MIMII DUE, a new dataset for malfunctioning industrial machine investigation and inspection with domain shifts due to changes in operational and environmental conditions.
• OpenP5: An Open-Source Platform for Developing, Training, and Evaluating LLM-based Recommender Systems
  19 Jun 2023 4 repositories listed Syntology ran 13 of 25 samples · 12 unverified
  In recent years, the integration of Large Language Models (LLMs) into recommender systems has garnered interest among both practitioners and researchers.
• Description and Discussion on DCASE 2021 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring under Domain Shifted Conditions
  8 Jun 2021 4 repositories listed
  In 2020, we organized an unsupervised anomalous sound detection (ASD) task, identifying whether a given sound was normal or anomalous without anomalous training data.
• Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need
  13 Mar 2023 3 repositories listed
  In this work, we revisit CIL with PTMs and argue that the core factors in CIL are adaptivity for model updating and generalizability for knowledge transferring.
• Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media
  15 Jul 2020 3 repositories listed
  The first four tasks compose the full pipeline of claim verification in social media: Task 1 on check-worthiness estimation, Task 2 on retrieving previously fact-checked claims, Task 3 on evidence retrieval, and Task 4…
• Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring
  10 Jun 2020 3 repositories listed
  The main challenge of this task is to detect unknown anomalous sounds under the condition that only normal sound samples have been provided as training data.
• CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Media
  21 Jan 2020 3 repositories listed
  Finally, the lab offers a fifth task that asks to predict the check-worthiness of the claims made in English political debates and speeches.
• General-purpose Tagging of Freesound Audio with AudioSet Labels: Task Description, Dataset, and Baseline
  26 Jul 2018 3 repositories listed
  The goal of the task is to build an audio tagging system that can recognize the category of an audio clip from a subset of 41 diverse categories drawn from the AudioSet Ontology.
• NTUA-SLP at SemEval-2018 Task 2: Predicting Emojis using RNNs with Context-aware Attention
  18 Apr 2018 3 repositories listed
  In this paper we present a deep-learning model that competed at SemEval-2018 Task 2 "Multilingual Emoji Prediction".
• Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation
  5 Jun 2024 2 repositories listed
  In our work, we introduce an argument mining dataset that captures the end-to-end process of preparing an argumentative essay for a debate, which covers the tasks of claim and evidence identification (Task 1 ED),…
• POLAR-Sim: Augmenting NASA's POLAR Dataset for Data-Driven Lunar Perception and Rover Simulation
  21 Sep 2023 2 repositories listed
  For Task 2, one can produce as much data as desired to train and test AI algorithms that are anticipated to work in lunar conditions.
• Description and Discussion on DCASE 2023 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoring
  13 May 2023 2 repositories listed
  In 2023 Task 2, we focus on solving the first-shot problem, which is the challenge of training a model on a completely novel machine type.
• First-shot anomaly sound detection for machine condition monitoring: A domain generalization baseline
  1 Mar 2023 2 repositories listed
  This paper provides a baseline system for First-shot-compliant unsupervised anomaly detection (ASD) for machine condition monitoring.
• Collecting Interactive Multi-modal Datasets for Grounded Language Understanding
  12 Nov 2022 2 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  Human intelligence can remarkably adapt quickly to new tasks and environments.
• Description and Discussion on DCASE 2022 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring Applying Domain Generalization Techniques
  13 Jun 2022 2 repositories listed
  We present the task description and discussion on the results of the DCASE 2022 Challenge Task 2: ``Unsupervised anomalous sound detection (ASD) for machine condition monitoring applying domain generalization…
• "This is my unicorn, Fluffy": Personalizing frozen vision-language representations
  4 Apr 2022 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  We propose an architecture for solving PerVL that operates by extending the input vocabulary of a pretrained model with new word embeddings for the new personalized concepts.
• The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification
  5 Jul 2021 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  The BraTS 2021 challenge celebrates its 10th anniversary and is jointly organized by the Radiological Society of North America (RSNA), the American Society of Neuroradiology (ASNR), and the Medical Image Computing and…
• cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction using Transformer-based Language Models pre-trained on various text corpora
  4 Jun 2021 2 repositories listed
  This paper describes the performance of the team cs60075_team2 at SemEval 2021 Task 1 - Lexical Complexity Prediction.
• Data Valuation using Reinforcement Learning
  25 Sep 2019 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  To adaptively learn data values jointly with the target task predictor model, we propose a meta learning framework which we name Data Valuation using Reinforcement Learning (DVRL).
• Audio tagging with noisy labels and minimal supervision
  7 Jun 2019 2 repositories listed
  The task evaluates systems for multi-label audio tagging using a large set of noisy-labeled data, and a much smaller set of manually-labeled data, under a large vocabulary setting of 80 everyday sound classes.
• General audio tagging with ensembling convolutional neural network and statistical features
  30 Oct 2018 2 repositories listed
  Audio tagging is challenging due to the limited size of data and noisy labels.
• ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational Knowledge
  11 Apr 2017 2 repositories listed
  This paper describes Luminoso's participation in SemEval 2017 Task 2, "Multilingual and Cross-lingual Semantic Word Similarity", with a system based on ConceptNet.
• Prompt Tuning Vision Language Models with Margin Regularizer for Few-Shot Learning under Distribution Shifts
  21 May 2025 1 repository listed
  PromptMargin effectively tunes the text as well as visual prompts for this task, and has two main modules: 1) Firstly, we use a selective augmentation strategy to complement the few training samples in each task; 2)…
• LLM-BABYBENCH: Understanding and Evaluating Grounded Planning and Reasoning in LLMs
  17 May 2025 1 repository listed
  Assessing the capacity of Large Language Models (LLMs) to plan and reason within the constraints of interactive environments is crucial for developing capable AI agents.
• 1ˢᵗ Place Solution of WWW 2025 EReL@MIR Workshop Multimodal CTR Prediction Challenge
  6 May 2025 1 repository listed
  The WWW 2025 EReL@MIR Workshop Multimodal CTR Prediction Challenge focuses on effectively applying multimodal embedding features to improve click-through rate (CTR) prediction in recommender systems.
• Feature Fusion Revisited: Multimodal CTR Prediction for MMCTR Challenge
  26 Apr 2025 1 repository listed
  With the rapid advancement of Multimodal Large Language Models (MLLMs), an increasing number of researchers are exploring their application in recommendation systems.
• FinBERT-QA: Financial Question Answering with pre-trained BERT Language Models
  24 Apr 2025 1 repository listed
  Our system focuses on financial non-factoid answer selection, which retrieves a set of passage-level texts and selects the most relevant as the answer.
• Quadratic Interest Network for Multimodal Click-Through Rate Prediction
  24 Apr 2025 1 repository listed
  Multimodal click-through rate (CTR) prediction is a key technique in industrial recommender systems.

Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.