Browse State-of-the-Art › DNN Testing
DNN Testing
10 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Testing the reliability of DNNs.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 27 · with a code link: 10 · where Syntology ran a sample: 0 (0 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran: none of the 27 tagged papers has a Syntology run on record
Page 1 of 1: papers 1 to 27 of 27, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
3 Apr 2025 1 repository listedDeep neural network (DNN) testing is crucial for the reliability and safety of critical systems, where failures can have severe consequences.
-
12 Aug 2024 1 repository listedEvaluating the behavioral boundaries of deep learning (DL) systems is crucial for understanding their reliability across diverse, unseen inputs.
-
5 Aug 2022 1 repository listedDeep neural network (DNN) models, including those used in safety-critical domains, need to be thoroughly tested to ensure that they can reliably perform well in different scenarios.
-
20 Dec 2021 1 repository listedIn this paper, we investigate black-box input diversity metrics as an alternative to white-box coverage criteria.
-
3 Dec 2021 1 repository listedWe demonstrate that NLC is significantly correlated with the diversity of a test suite across a number of tasks (classification and generation) and data formats (image and text).
-
19 Jun 2021 1 repository listedMetaVQA checks whether the answer to (i, q) satisfies metamorphic relationships (MRs), denoting perception consistency, with the composed answers of transformed questions and images.
-
26 Feb 2021 1 repository listedUsing deep generative model based input validation, we show that all the three techniques generate significant number of invalid test inputs.
-
25 Jan 2021 1 repository listedIt is shown that DeepPAC outperforms the state-of-the-art statistical method PROVERO, and it achieves more practical robustness analysis than the formal verification tool ERAN.
-
6 Jun 2019 1 repository listedWith the increasing adoption of Deep Neural Network (DNN) models as integral parts of software systems, efficient operational testing of DNNs is much in demand to ensure these models' actual performance in field…
-
20 May 2019 1 repository listedWe found that many of the reported erroneous cases in popular DNN image classifiers occur because the trained models confuse one class with another or show biases towards some classes over others.
-
GAN-enhanced Simulation-driven DNN Testing in Absence of Ground Truth20 Mar 2025 0 repositories listedThe generation of synthetic inputs via simulators driven by search algorithms is essential for cost-effective testing of Deep Neural Network (DNN) components for safety-critical systems.
-
DANDI: Diffusion as Normative Distribution for Deep Neural Network Input5 Feb 2025 0 repositories listedSurprise Adequacy (SA) has been widely studied as a test adequacy metric that can effectively guide software engineers towards inputs that are more likely to reveal unexpected behaviour of Deep Neural Networks (DNNs).
-
Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems25 Aug 2024 0 repositories listedDeep Neural Networks (DNNs) for Autonomous Driving Systems (ADS) are typically trained on real-world images and tested using synthetic simulator images.
-
DeepSample: DNN sampling-based testing for operational accuracy assessment28 Mar 2024 0 repositories listedDeep Neural Networks (DNN) are core components for classification and regression tasks of many software systems.
-
DeepKnowledge: Generalisation-Driven Deep Learning Testing25 Mar 2024 0 repositories listedDespite their unprecedented success, DNNs are notoriously fragile to small shifts in data distribution, demanding effective testing techniques that can assess their dependability.
-
Rethinking Diversity in Deep Neural Network Testing25 May 2023 0 repositories listedMotivated by the success of traditional software testing, numerous diversity measures have been proposed for testing deep neural networks (DNNs).
-
CGDTest: A Constrained Gradient Descent Algorithm for Testing Neural Networks4 Apr 2023 0 repositories listedIn this paper, we propose a new Deep Neural Network (DNN) testing algorithm called the Constrained Gradient Descent (CGD) method, and an implementation we call CGDTest aimed at exposing security and robustness issues…
-
NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural Networks24 Mar 2022 0 repositories listedDeep learning has recently been widely applied to many applications across different domains, e.g., image classification and audio recognition.
-
CatchBackdoor: Backdoor Detection via Critical Trojan Neural Path Fuzzing24 Dec 2021 0 repositories listedThe success of deep neural networks (DNNs) in real-world applications has benefited from abundant pre-trained models.
-
Provably Valid and Diverse Mutations of Real-World Media Data for DNN Testing3 Dec 2021 0 repositories listedDeep neural networks (DNNs) often accept high-dimensional media data (e.g., photos, text, and audio) and understand their perceptual content (e.g., a cat).
-
Exposing Previously Undetectable Faults in Deep Neural Networks1 Jun 2021 0 repositories listedExisting methods for testing DNNs solve the oracle problem by constraining the raw features (e.g. image pixel values) to be within a small distance of a dataset example for which the desired DNN output is known.
-
Neuron Coverage-Guided Domain Generalization27 Feb 2021 0 repositories listedThis paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training.
-
IWA: Integrated Gradient based White-box Attacks for Fooling Deep Neural Networks3 Feb 2021 0 repositories listedThe widespread application of deep neural network (DNN) techniques is being challenged by adversarial examples, the legitimate input added with imperceptible and well-designed perturbations that can fool DNNs easily in…
-
Automatic Test Suite Generation for Key-Points Detection DNNs using Many-Objective Search (Experience Paper)11 Dec 2020 0 repositories listedAutomatically detecting the positions of key-points (e.g., facial key-points or finger key-points) in an image is an essential problem in many applications, such as driver's gaze detection and drowsiness detection in…
-
Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study28 Nov 2019 0 repositories listedThere is a growing body of research on developing testing techniques for Deep Neural Networks (DNN).
-
DeepFault: Fault Localization for Deep Neural Networks15 Feb 2019 0 repositories listedDeep Neural Networks (DNNs) are increasingly deployed in safety-critical applications including autonomous vehicles and medical diagnostics.
-
DeepBillboard: Systematic Physical-World Testing of Autonomous Driving Systems27 Dec 2018 0 repositories listedFurthermore, DeepBillboard is sufficiently robust and resilient for generating physical-world adversarial billboard tests for real-world driving under various weather conditions.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections