Browse State-of-the-Art › DNN Testing

DNN Testing

10 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28

Adversarial

Testing the reliability of DNNs.

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Papers archive 2025-07-28

archive papers tagged: 27 · with a code link: 10 · where Syntology ran a sample: 0 (0 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran: none of the 27 tagged papers has a Syntology run on record

Page 1 of 1: papers 1 to 27 of 27, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.

  • 3 Apr 2025 1 repository listed
    Deep neural network (DNN) testing is crucial for the reliability and safety of critical systems, where failures can have severe consequences.
  • 12 Aug 2024 1 repository listed
    Evaluating the behavioral boundaries of deep learning (DL) systems is crucial for understanding their reliability across diverse, unseen inputs.
  • 5 Aug 2022 1 repository listed
    Deep neural network (DNN) models, including those used in safety-critical domains, need to be thoroughly tested to ensure that they can reliably perform well in different scenarios.
  • 20 Dec 2021 1 repository listed
    In this paper, we investigate black-box input diversity metrics as an alternative to white-box coverage criteria.
  • 3 Dec 2021 1 repository listed
    We demonstrate that NLC is significantly correlated with the diversity of a test suite across a number of tasks (classification and generation) and data formats (image and text).
  • 19 Jun 2021 1 repository listed
    MetaVQA checks whether the answer to (i, q) satisfies metamorphic relationships (MRs), denoting perception consistency, with the composed answers of transformed questions and images.
  • 26 Feb 2021 1 repository listed
    Using deep generative model based input validation, we show that all the three techniques generate significant number of invalid test inputs.
  • 25 Jan 2021 1 repository listed
    It is shown that DeepPAC outperforms the state-of-the-art statistical method PROVERO, and it achieves more practical robustness analysis than the formal verification tool ERAN.
  • 6 Jun 2019 1 repository listed
    With the increasing adoption of Deep Neural Network (DNN) models as integral parts of software systems, efficient operational testing of DNNs is much in demand to ensure these models' actual performance in field…
  • 20 May 2019 1 repository listed
    We found that many of the reported erroneous cases in popular DNN image classifiers occur because the trained models confuse one class with another or show biases towards some classes over others.
  • GAN-enhanced Simulation-driven DNN Testing in Absence of Ground Truth
    20 Mar 2025 0 repositories listed
    The generation of synthetic inputs via simulators driven by search algorithms is essential for cost-effective testing of Deep Neural Network (DNN) components for safety-critical systems.
  • DANDI: Diffusion as Normative Distribution for Deep Neural Network Input
    5 Feb 2025 0 repositories listed
    Surprise Adequacy (SA) has been widely studied as a test adequacy metric that can effectively guide software engineers towards inputs that are more likely to reveal unexpected behaviour of Deep Neural Networks (DNNs).
  • Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems
    25 Aug 2024 0 repositories listed
    Deep Neural Networks (DNNs) for Autonomous Driving Systems (ADS) are typically trained on real-world images and tested using synthetic simulator images.
  • DeepSample: DNN sampling-based testing for operational accuracy assessment
    28 Mar 2024 0 repositories listed
    Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems.
  • DeepKnowledge: Generalisation-Driven Deep Learning Testing
    25 Mar 2024 0 repositories listed
    Despite their unprecedented success, DNNs are notoriously fragile to small shifts in data distribution, demanding effective testing techniques that can assess their dependability.
  • Rethinking Diversity in Deep Neural Network Testing
    25 May 2023 0 repositories listed
    Motivated by the success of traditional software testing, numerous diversity measures have been proposed for testing deep neural networks (DNNs).
  • CGDTest: A Constrained Gradient Descent Algorithm for Testing Neural Networks
    4 Apr 2023 0 repositories listed
    In this paper, we propose a new Deep Neural Network (DNN) testing algorithm called the Constrained Gradient Descent (CGD) method, and an implementation we call CGDTest aimed at exposing security and robustness issues…
  • NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural Networks
    24 Mar 2022 0 repositories listed
    Deep learning has recently been widely applied to many applications across different domains, e.g., image classification and audio recognition.
  • CatchBackdoor: Backdoor Detection via Critical Trojan Neural Path Fuzzing
    24 Dec 2021 0 repositories listed
    The success of deep neural networks (DNNs) in real-world applications has benefited from abundant pre-trained models.
  • Provably Valid and Diverse Mutations of Real-World Media Data for DNN Testing
    3 Dec 2021 0 repositories listed
    Deep neural networks (DNNs) often accept high-dimensional media data (e.g., photos, text, and audio) and understand their perceptual content (e.g., a cat).
  • Exposing Previously Undetectable Faults in Deep Neural Networks
    1 Jun 2021 0 repositories listed
    Existing methods for testing DNNs solve the oracle problem by constraining the raw features (e.g. image pixel values) to be within a small distance of a dataset example for which the desired DNN output is known.
  • Neuron Coverage-Guided Domain Generalization
    27 Feb 2021 0 repositories listed
    This paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training.
  • IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural Networks
    3 Feb 2021 0 repositories listed
    The widespread application of deep neural network (DNN) techniques is being challenged by adversarial examples, the legitimate input added with imperceptible and well-designed perturbations that can fool DNNs easily in…
  • Automatic Test Suite Generation for Key-Points Detection DNNs using Many-Objective Search (Experience Paper)
    11 Dec 2020 0 repositories listed
    Automatically detecting the positions of key-points (e.g., facial key-points or finger key-points) in an image is an essential problem in many applications, such as driver's gaze detection and drowsiness detection in…
  • Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study
    28 Nov 2019 0 repositories listed
    There is a growing body of research on developing testing techniques for Deep Neural Networks (DNN).
  • DeepFault: Fault Localization for Deep Neural Networks
    15 Feb 2019 0 repositories listed
    Deep Neural Networks (DNNs) are increasingly deployed in safety-critical applications including autonomous vehicles and medical diagnostics.
  • DeepBillboard: Systematic Physical-World Testing of Autonomous Driving Systems
    27 Dec 2018 0 repositories listed
    Furthermore, DeepBillboard is sufficiently robust and resilient for generating physical-world adversarial billboard tests for real-world driving under various weather conditions.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections