DNN Testing

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

10 shown of 10 papers with code (27 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• RBT4DNN: Requirements-based Testing of Neural Networks
  3 Apr 2025 1 repository listed
  Deep neural network (DNN) testing is crucial for the reliability and safety of critical systems, where failures can have severe consequences.
• Targeted Deep Learning System Boundary Testing
  12 Aug 2024 1 repository listed
  Evaluating the behavioral boundaries of deep learning (DL) systems is crucial for understanding their reliability across diverse, unseen inputs.
• An Overview of Structural Coverage Metrics for Testing Neural Networks
  5 Aug 2022 1 repository listed
  Deep neural network (DNN) models, including those used in safety-critical domains, need to be thoroughly tested to ensure that they can reliably perform well in different scenarios.
• Black-Box Testing of Deep Neural Networks Through Test Case Diversity
  20 Dec 2021 1 repository listed
  In this paper, we investigate black-box input diversity metrics as an alternative to white-box coverage criteria.
• Revisiting Neuron Coverage for DNN Testing: A Layer-Wise and Distribution-Aware Criterion
  3 Dec 2021 1 repository listed
  We demonstrate that NLC is significantly correlated with the diversity of a test suite across a number of tasks (classification and generation) and data formats (image and text).
• Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing
  19 Jun 2021 1 repository listed
  MetaVQA checks whether the answer to (i, q) satisfies metamorphic relationships (MRs), denoting perception consistency, with the composed answers of transformed questions and images.
• Distribution-Aware Testing of Neural Networks Using Generative Models
  26 Feb 2021 1 repository listed
  Using deep generative model based input validation, we show that all the three techniques generate significant number of invalid test inputs.
• Towards Practical Robustness Analysis for DNNs based on PAC-Model Learning
  25 Jan 2021 1 repository listed
  It is shown that DeepPAC outperforms the state-of-the-art statistical method PROVERO, and it achieves more practical robustness analysis than the formal verification tool ERAN.
• Boosting Operational DNN Testing Efficiency through Conditioning
  6 Jun 2019 1 repository listed
  With the increasing adoption of Deep Neural Network (DNN) models as integral parts of software systems, efficient operational testing of DNNs is much in demand to ensure these models' actual performance in field…
• Testing DNN Image Classifiers for Confusion & Bias Errors
  20 May 2019 1 repository listed
  We found that many of the reported erroneous cases in popular DNN image classifiers occur because the trained models confuse one class with another or show biases towards some classes over others.