Methods › General › Activation Functions › ReLU › Papers, page 78
ReLU
Papers archive 2025-07-28
archive papers tagged: 10,350 · with a code link: 4,256 · where Syntology ran a sample: 1,079 (909 with a run with no instrument failure, 170 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (1,079 of 10,350 tagged: 909 with a run with no instrument failure, 170 where every run was a failure of Syntology's instrument)
Page 78 of 104: papers 7,701 to 7,800 of 10,350, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
HUBERT Untangles BERT to Improve Transfer across NLP Tasks 25 Oct 2019 · 1 repository · arXiv:1910.12647
-
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders 25 Oct 2019 · 7 repositories · arXiv:1910.12638Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram 25 Oct 2019 · 12 repositories · arXiv:1910.11480Syntology 17 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 20 harvested samples) · 1 pointer-only (licence)
-
Towards Online End-to-end Transformer Automatic Speech Recognition 25 Oct 2019 · 0 repositories · arXiv:1910.11871
-
An Empirical Study of Efficient ASR Rescoring with Transformers 24 Oct 2019 · 0 repositories · arXiv:1910.11450
-
Emotion recognition with 4kresolution database 24 Oct 2019 · 0 repositories · arXiv:1910.11276
-
ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit 24 Oct 2019 · 3 repositories · arXiv:1910.10909Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Promoting the Knowledge of Source Syntax in Transformer NMT Is Not Needed 24 Oct 2019 · 0 repositories · arXiv:1910.11218
-
U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging 24 Oct 2019 · 5 repositories · arXiv:1910.11162Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Unified Multi-scale Feature Abstraction for Medical Image Segmentation 24 Oct 2019 · 0 repositories · arXiv:1910.11456
-
A Transformer with Interleaved Self-attention and Convolution for Hybrid Acoustic Models 23 Oct 2019 · 1 repository · arXiv:1910.10352
-
Controlling the Output Length of Neural Machine Translation 23 Oct 2019 · 0 repositories · arXiv:1910.10408
-
Correction of Automatic Speech Recognition with Transformer Sequence-to-sequence Model 23 Oct 2019 · 0 repositories · arXiv:1910.10697
-
Deja-vu: Double Feature Presentation and Iterated Loss in Deep Transformer Networks 23 Oct 2019 · 2 repositories · arXiv:1910.10324
-
Identification of primary angle-closure on AS-OCT images with Convolutional Neural Networks 23 Oct 2019 · 0 repositories · arXiv:1910.10414
-
Neural Ordinary Differential Equations for Semantic Segmentation of Individual Colon Glands 23 Oct 2019 · 2 repositories · arXiv:1910.10470
-
Semantic Segmentation of Skin Lesions using a Small Data Set 23 Oct 2019 · 0 repositories · arXiv:1910.10534
-
TCT: A Cross-supervised Learning Method for Multimodal Sequence Representation 23 Oct 2019 · 0 repositories · arXiv:1911.05186
-
4-Connected Shift Residual Networks 22 Oct 2019 · 1 repository · arXiv:1910.09931
-
Complex Transformer: A Framework for Modeling Complex-Valued Sequence 22 Oct 2019 · 1 repository · arXiv:1910.10202Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
Exchangeable deep neural networks for set-to-set matching and learning 22 Oct 2019 · 2 repositories · arXiv:1910.09972
-
Depth-Adaptive Transformer 22 Oct 2019 · 0 repositories · arXiv:1910.10073
-
Improving Siamese Networks for One Shot Learning using Kernel Based Activation functions 22 Oct 2019 · 1 repository · arXiv:1910.09798
-
Improving Transformer-based Speech Recognition Using Unsupervised Pre-training 22 Oct 2019 · 1 repository · arXiv:1910.09932
-
Self-Correction for Human Parsing 22 Oct 2019 · 2 repositories · arXiv:1910.09777Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Sequence-to-sequence Singing Synthesis Using the Feed-forward Transformer 22 Oct 2019 · 0 repositories · arXiv:1910.09989
-
CycleGAN Voice Conversion of Spectral Envelopes using Adversarial Weights 22 Oct 2019 · 0 repositories · arXiv:1910.12614
-
Transformer-based Acoustic Modeling for Hybrid Speech Recognition 22 Oct 2019 · 0 repositories · arXiv:1910.09799
-
Approximation capabilities of neural networks on unbounded domains 21 Oct 2019 · 0 repositories · arXiv:1910.09293
-
Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks 21 Oct 2019 · 0 repositories · arXiv:1910.09455
-
Directed-Weighting Group Lasso for Eltwise Blocked CNN Pruning 21 Oct 2019 · 0 repositories · arXiv:1910.09318
-
Improving Vehicle Re-Identification using CNN Latent Spaces: Metrics Comparison and Track-to-track Extension 21 Oct 2019 · 1 repository · arXiv:1910.09458
-
KuroNet: Pre-Modern Japanese Kuzushiji Character Recognition with Deep Learning 21 Oct 2019 · 0 repositories · arXiv:1910.09433
-
Learning to Make Generalizable and Diverse Predictions for Retrosynthesis 21 Oct 2019 · 0 repositories · arXiv:1910.09688
-
MIScnn: A Framework for Medical Image Segmentation with Convolutional Neural Networks and Deep Learning 21 Oct 2019 · 1 repository · arXiv:1910.09308
-
Transformer-CNN: Fast and Reliable tool for QSAR 21 Oct 2019 · 1 repository · arXiv:1911.06603
-
On the space-time expressivity of ResNets 21 Oct 2019 · 0 repositories · arXiv:1910.09599
-
Deep speech inpainting of time-frequency masks 20 Oct 2019 · 2 repositories · arXiv:1910.09058
-
Image Difficulty Curriculum for Generative Adversarial Networks (CuGAN) 20 Oct 2019 · 1 repository · arXiv:1910.08967
-
MixModule: Mixed CNN Kernel Module for Medical Image Segmentation 19 Oct 2019 · 0 repositories · arXiv:1910.08728
-
SPARK: Spatial-aware Online Incremental Attack Against Visual Tracking 19 Oct 2019 · 1 repository · arXiv:1910.08681
-
Tracking-Assisted Segmentation of Biological Cells 19 Oct 2019 · 0 repositories · arXiv:1910.08735
-
BOBBY2: Buffer Based Robust High-Speed Object Tracking 18 Oct 2019 · 1 repository · arXiv:1910.08263
-
Intracranial Hemorrhage Segmentation Using Deep Convolutional Model 18 Oct 2019 · 1 repository · arXiv:1910.08643Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
SurReal: Complex-Valued Learning as Principled Transformations on a Scaling and Rotation Manifold 18 Oct 2019 · 1 repository · arXiv:1910.11334Syntology 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Towards Quantifying Intrinsic Generalization of Deep ReLU Networks 18 Oct 2019 · 0 repositories · arXiv:1910.08581
-
Fully Quantized Transformer for Machine Translation 17 Oct 2019 · 0 repositories · arXiv:1910.10485
-
Predicting retrosynthetic pathways using a combined linguistic model and hyper-graph exploration strategy 17 Oct 2019 · 0 repositories · arXiv:1910.08036
-
Question Classification with Deep Contextualized Transformer 17 Oct 2019 · 1 repository · arXiv:1910.10492
-
Conservation AI: Live Stream Analysis for the Detection of Endangered Species Using Convolutional Neural Networks and Drone Technology 16 Oct 2019 · 0 repositories · arXiv:1910.07360
-
Efficiency through Auto-Sizing: Notre Dame NLP's Submission to the WNGT 2019 Efficiency Task 16 Oct 2019 · 0 repositories · arXiv:1910.07134
-
Evolution of transfer learning in natural language processing 16 Oct 2019 · 0 repositories · arXiv:1910.07370
-
Hidden Unit Specialization in Layered Neural Networks: ReLU vs. Sigmoidal Activation 16 Oct 2019 · 0 repositories · arXiv:1910.07476
-
Imperial College London Submission to VATEX Video Captioning Task 16 Oct 2019 · 0 repositories · arXiv:1910.07482
-
Injecting Hierarchy with U-Net Transformers 16 Oct 2019 · 2 repositories · arXiv:1910.10488
-
Analyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response Models 16 Oct 2019 · 0 repositories · arXiv:1910.07117
-
Offline handwritten mathematical symbol recognition utilising deep learning 16 Oct 2019 · 0 repositories · arXiv:1910.07395
-
Transformer ASR with Contextual Block Processing 16 Oct 2019 · 0 repositories · arXiv:1910.07204
-
Using Whole Document Context in Neural Machine Translation 16 Oct 2019 · 0 repositories · arXiv:1910.07481
-
Analyzing Large Receptive Field Convolutional Networks for Distant Speech Recognition 15 Oct 2019 · 0 repositories · arXiv:1910.07047
-
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving 15 Oct 2019 · 3 repositories · arXiv:1910.06611Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)
-
Facebook AI's WAT19 Myanmar-English Translation Task Submission 15 Oct 2019 · 0 repositories · arXiv:1910.06848
-
Full-Scale Continuous Synthetic Sonar Data Generation with Markov Conditional Generative Adversarial Networks 15 Oct 2019 · 0 repositories · arXiv:1910.06750
-
Neural tangent kernels, transportation mappings, and universal approximation 15 Oct 2019 · 0 repositories · arXiv:1910.06956
-
ICPS-net: An End-to-End RGB-based Indoor Camera Positioning System using deep convolutional neural networks 14 Oct 2019 · 0 repositories · arXiv:1910.06219
-
Automatic Neural Network Compression by Sparsity-Quantization Joint Learning: A Constrained Optimization-based Approach 14 Oct 2019 · 1 repository · arXiv:1910.05897
-
Structured Pruning of a BERT-based Question Answering Model 14 Oct 2019 · 0 repositories · arXiv:1910.06360
-
Q8BERT: Quantized 8Bit BERT 14 Oct 2019 · 5 repositories · arXiv:1910.06188Syntology official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 3 pointer-only (licence)
-
Structure Preserving Compressive Sensing MRI Reconstruction using Generative Adversarial Networks 14 Oct 2019 · 1 repository · arXiv:1910.06067
-
Transformers without Tears: Improving the Normalization of Self-Attention 14 Oct 2019 · 5 repositories · arXiv:1910.05895Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Vertebrae Detection and Localization in CT with Two-Stage CNNs and Dense Annotations 14 Oct 2019 · 1 repository · arXiv:1910.05911
-
Generalization Bounds for Neural Networks via Approximate Description Length 13 Oct 2019 · 0 repositories · arXiv:1910.05697
-
If dropout limits trainable depth, does critical initialisation still matter? A large-scale statistical analysis on ReLU networks 13 Oct 2019 · 0 repositories · arXiv:1910.05725
-
Large Deviation Analysis of Function Sensitivity in Random Deep Neural Networks 13 Oct 2019 · 0 repositories · arXiv:1910.05769
-
Radiomic Feature Stability Analysis based on Probabilistic Segmentations 13 Oct 2019 · 0 repositories · arXiv:1910.05693
-
Stabilizing Transformers for Reinforcement Learning 13 Oct 2019 · 5 repositories · arXiv:1910.06764Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
How are attributes expressed in face DCNNs? 12 Oct 2019 · 0 repositories · arXiv:1910.05657
-
On the expected behaviour of noise regularised deep neural networks as Gaussian processes 12 Oct 2019 · 0 repositories · arXiv:1910.05563
-
Aff-Wild Database and AffWildNet 11 Oct 2019 · 1 repository · arXiv:1910.05318
-
Deep Independently Recurrent Neural Network (IndRNN) 11 Oct 2019 · 1 repository · arXiv:1910.06251
-
Illegible Text to Readable Text: An Image-to-Image Transformation using Conditional Sliced Wasserstein Adversarial Networks 11 Oct 2019 · 0 repositories · arXiv:1910.05425
-
Shape Constrained Network for Eye Segmentation in the Wild 11 Oct 2019 · 0 repositories · arXiv:1910.05283
-
A cost-effective method for improving and re-purposing large, pre-trained GANs by fine-tuning their class-embeddings 10 Oct 2019 · 1 repository · arXiv:1910.04760
-
On Recognizing Texts of Arbitrary Shapes with 2D Self-Attention 10 Oct 2019 · 2 repositories · arXiv:1910.04396
-
Manhattan Room Layout Reconstruction from a Single 360 image: A Comparative Study of State-of-the-art Methods 9 Oct 2019 · 3 repositories · arXiv:1910.04099
-
Ctrl-Z: Recovering from Instability in Reinforcement Learning 9 Oct 2019 · 0 repositories · arXiv:1910.03732
-
On the adequacy of untuned warmup for adaptive optimization 9 Oct 2019 · 1 repository · arXiv:1910.04209Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
PipeMare: Asynchronous Pipeline Parallel DNN Training 9 Oct 2019 · 0 repositories · arXiv:1910.05124
-
Prescribed Generative Adversarial Networks 9 Oct 2019 · 2 repositories · arXiv:1910.04302
-
HuggingFace's Transformers: State-of-the-art Natural Language Processing 9 Oct 2019 · 9 repositories · arXiv:1910.03771Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Deep Network Classification by Scattering and Homotopy Dictionary Learning 8 Oct 2019 · 1 repository · arXiv:1910.03561Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks 8 Oct 2019 · 13 repositories · arXiv:1910.03151Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Identifying nonlinear dynamical systems with multiple time scales and long-range dependencies 8 Oct 2019 · 0 repositories · arXiv:1910.03471
-
Multi-Source Domain Adaptation and Semi-Supervised Domain Adaptation with Focus on Visual Domain Adaptation Challenge 2019 8 Oct 2019 · 2 repositories · arXiv:1910.03548
-
Improved Res2Net model for Person re-identification 8 Oct 2019 · 0 repositories · arXiv:1910.04061
-
TorchBeast: A PyTorch Platform for Distributed RL 8 Oct 2019 · 3 repositories · arXiv:1910.03552Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
The Universal Approximation Property 8 Oct 2019 · 0 repositories · arXiv:1910.03344
-
Deformable Kernels: Adapting Effective Receptive Fields for Object Deformation 7 Oct 2019 · 2 repositories · arXiv:1910.02940
-
Neural network integral representations with the ReLU activation function 7 Oct 2019 · 0 repositories · arXiv:1910.02743
-
Noise as Domain Shift: Denoising Medical Images by Unpaired Image Translation 7 Oct 2019 · 1 repository · arXiv:1910.02702