Methods › General › Feedforward Networks › Position-Wise Feed-Forward Layer › Papers, page 122
Position-Wise Feed-Forward Layer
Papers archive 2025-07-28
archive papers tagged: 13,895 · with a code link: 6,514 · where Syntology ran a sample: 2,229 (1,902 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,229 of 13,895 tagged: 1,902 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 122 of 139: papers 12,101 to 12,200 of 13,895, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Carbon Emissions and Large Neural Network Training 21 Apr 2021 · 0 repositories · arXiv:2104.10350
-
Label-Synchronous Speech-to-Text Alignment for ASR Using Forward and Backward Transformers 21 Apr 2021 · 0 repositories · arXiv:2104.10328
-
Efficient pre-training objectives for Transformers 20 Apr 2021 · 0 repositories · arXiv:2104.09694
-
Modeling Event Plausibility with Consistent Conceptual Abstraction 20 Apr 2021 · 1 repository · arXiv:2104.10247Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings 19 Apr 2021 · 0 repositories · arXiv:2104.09079
-
Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers 19 Apr 2021 · 0 repositories · arXiv:2104.09426
-
Code Structure Guided Transformer for Source Code Summarization 19 Apr 2021 · 0 repositories · arXiv:2104.09340
-
Extracting Temporal Event Relation with Syntax-guided Graph Transformer 19 Apr 2021 · 1 repository · arXiv:2104.09570
-
Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence 19 Apr 2021 · 0 repositories · arXiv:2104.09393
-
Multi-Modal Fusion Transformer for End-to-End Autonomous Driving 19 Apr 2021 · 2 repositories · arXiv:2104.09224Syntology official (archive's flag): 3 ran · 9 ran (of which 7 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 15 harvested samples)
-
TransCrowd: weakly-supervised crowd counting with transformers 19 Apr 2021 · 1 repository · arXiv:2104.09116
-
Attention-based Clinical Note Summarization 18 Apr 2021 · 1 repository · arXiv:2104.08942
-
A Simple and Effective Positional Encoding for Transformers 18 Apr 2021 · 0 repositories · arXiv:2104.08698
-
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks 18 Apr 2021 · 1 repository · arXiv:2104.08815
-
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs 18 Apr 2021 · 2 repositories · arXiv:2104.08692
-
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation 18 Apr 2021 · 1 repository · arXiv:2104.08771Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset 18 Apr 2021 · 2 repositories · arXiv:2104.08671Syntology official (archive's flag): 1 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples)
-
Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification 17 Apr 2021 · 1 repository · arXiv:2104.08444
-
Higher Order Recurrent Space-Time Transformer for Video Action Prediction 17 Apr 2021 · 1 repository · arXiv:2104.08665
-
Vision Transformer Pruning 17 Apr 2021 · 2 repositories · arXiv:2104.08500Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
Comparison of Grammatical Error Correction Using Back-Translation Models 16 Apr 2021 · 0 repositories · arXiv:2104.07848
-
Condenser: a Pre-training Architecture for Dense Retrieval 16 Apr 2021 · 1 repository · arXiv:2104.08253Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 3 harvested samples)
-
Counter-Interference Adapter for Multilingual Machine Translation 16 Apr 2021 · 1 repository · arXiv:2104.08154
-
Adaptive Sparse Transformer for Multilingual Translation 15 Apr 2021 · 0 repositories · arXiv:2104.07358
-
Cross-domain Speech Recognition with Unsupervised Character-level Distribution Matching 15 Apr 2021 · 1 repository · arXiv:2104.07491
-
Robust Optimization for Multilingual Translation with Imbalanced Data 15 Apr 2021 · 0 repositories · arXiv:2104.07639
-
Points as Queries: Weakly Semi-supervised Object Detection by Points 15 Apr 2021 · 1 repository · arXiv:2104.07434Syntology 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Rethinking Text Line Recognition Models 15 Apr 2021 · 0 repositories · arXiv:2104.07787
-
Self-supervised Video Object Segmentation by Motion Grouping 15 Apr 2021 · 0 repositories · arXiv:2104.07658
-
Shoulder Implant X-Ray Manufacturer Classification: Exploring with Vision Transformer 15 Apr 2021 · 1 repository · arXiv:2104.07667
-
Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling 15 Apr 2021 · 0 repositories · arXiv:2104.07704
-
TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction 15 Apr 2021 · 1 repository · arXiv:2104.07244
-
Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification 15 Apr 2021 · 0 repositories · arXiv:2104.07235
-
An Introduction of mini-AlphaStar 14 Apr 2021 · 1 repository · arXiv:2104.06890
-
Decoupled Spatial-Temporal Transformer for Video Inpainting 14 Apr 2021 · 1 repository · arXiv:2104.06637
-
Knowledge-driven Answer Generation for Conversational Search 14 Apr 2021 · 0 repositories · arXiv:2104.06892
-
NAREOR: The Narrative Reordering Problem 14 Apr 2021 · 1 repository · arXiv:2104.06669
-
Non-autoregressive sequence-to-sequence voice conversion 14 Apr 2021 · 0 repositories · arXiv:2104.06793
-
Sparse Attention with Linear Units 14 Apr 2021 · 3 repositories · arXiv:2104.07012Syntology official: harvested, nothing ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
-
TWEAC: Transformer with Extendable QA Agent Classifiers 14 Apr 2021 · 1 repository · arXiv:2104.07081
-
Can a Transformer Pass the Wug Test? Tuning Copying Bias in Neural Morphological Inflection Models 13 Apr 2021 · 0 repositories · arXiv:2104.06483
-
QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering 13 Apr 2021 · 6 repositories · arXiv:2104.06378Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 17 unverified (of 25 harvested samples) · 5 pointer-only (licence)
-
Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders 13 Apr 2021 · 0 repositories · arXiv:2104.05928
-
Transformer-based Methods for Recognizing Ultra Fine-grained Entities (RUFES) 13 Apr 2021 · 0 repositories · arXiv:2104.06048
-
UPB at SemEval-2021 Task 7: Adversarial Multi-Task Learning for Detecting and Rating Humor and Offense 13 Apr 2021 · 0 repositories · arXiv:2104.06063
-
ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration 13 Apr 2021 · 1 repository · arXiv:2104.06468Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
Cloth Interactive Transformer for Virtual Try-On 12 Apr 2021 · 1 repository · arXiv:2104.05519
-
Escaping the Big Data Paradigm with Compact Transformers 12 Apr 2021 · 9 repositories · arXiv:2104.05704Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
Family of Origin and Family of Choice: Massively Parallel Lexiconized Iterative Pretraining for Severely Low Resource Machine Translation 12 Apr 2021 · 0 repositories · arXiv:2104.05848
-
Learning dynamic and hierarchical traffic spatiotemporal features with Transformer 12 Apr 2021 · 0 repositories · arXiv:2104.05163
-
On Representation Learning for Scientific News Articles Using Heterogeneous Knowledge Graphs 12 Apr 2021 · 0 repositories · arXiv:2104.05866
-
Paragraph-level Simplification of Medical Texts 12 Apr 2021 · 1 repository · arXiv:2104.05767
-
Updater-Extractor Architecture for Inductive World State Representations 12 Apr 2021 · 0 repositories · arXiv:2104.05500
-
UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost 11 Apr 2021 · 0 repositories · arXiv:2104.04946
-
Deep Transformer Networks for Time Series Classification: The NPP Safety Case 9 Apr 2021 · 0 repositories · arXiv:2104.05448
-
Transformers: "The End of History" for NLP? 9 Apr 2021 · 0 repositories · arXiv:2105.00813
-
Layer Reduction: Accelerating Conformer-Based Self-Supervised Model via Layer Consistency 8 Apr 2021 · 0 repositories · arXiv:2105.00812
-
Revisiting Simple Neural Probabilistic Language Models 8 Apr 2021 · 1 repository · arXiv:2104.03474Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
Facial Attribute Transformers for Precise and Robust Makeup Transfer 7 Apr 2021 · 0 repositories · arXiv:2104.02894
-
Interpreting A Pre-trained Model Is A Key For Model Architecture Optimization: A Case Study On Wav2Vec 2.0 7 Apr 2021 · 0 repositories · arXiv:2104.02851
-
LI-Net: Large-Pose Identity-Preserving Face Reenactment Network 7 Apr 2021 · 0 repositories · arXiv:2104.02850
-
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning 7 Apr 2021 · 3 repositories · arXiv:2104.03135
-
Fourier Image Transformer 6 Apr 2021 · 1 repository · arXiv:2104.02555
-
LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring 6 Apr 2021 · 1 repository · arXiv:2104.02526
-
MuSLCAT: Multi-Scale Multi-Level Convolutional Attention Transformer for Discriminative Music Modeling on Raw Waveforms 6 Apr 2021 · 0 repositories · arXiv:2104.02309
-
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Neural Machine Translation 6 Apr 2021 · 0 repositories · arXiv:2104.02308
-
Variational Transformer Networks for Layout Generation 6 Apr 2021 · 0 repositories · arXiv:2104.02416
-
AST: Audio Spectrogram Transformer 5 Apr 2021 · 5 repositories · arXiv:2104.01778Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
IITK@Detox at SemEval-2021 Task 5: Semi-Supervised Learning and Dice Loss for Toxic Spans Detection 4 Apr 2021 · 1 repository · arXiv:2104.01566
-
IndT5: A Text-to-Text Transformer for 10 Indigenous Languages 4 Apr 2021 · 0 repositories · arXiv:2104.07483
-
TransfoRNN: Capturing the Sequential Information in Self-Attention Representations for Language Modeling 4 Apr 2021 · 0 repositories · arXiv:2104.01572
-
Deepfake Detection Scheme Based on Vision Transformer and Distillation 3 Apr 2021 · 1 repository · arXiv:2104.01353
-
Efficient DETR: Improving End-to-End Object Detector with Dense Prior 3 Apr 2021 · 0 repositories · arXiv:2104.01318
-
AAformer: Auto-Aligned Transformer for Person Re-Identification 2 Apr 2021 · 0 repositories · arXiv:2104.00921
-
Effect of depth order on iterative nested named entity recognition models 2 Apr 2021 · 0 repositories · arXiv:2104.01037
-
M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformers 2 Apr 2021 · 0 repositories · arXiv:2104.01122
-
Using GPT-2 to Create Synthetic Data to Improve the Prediction Performance of NLP Machine Learning Classification Models 2 Apr 2021 · 0 repositories · arXiv:2104.10658
-
A New View of Multi-modal Language Analysis: Audio and Video Features as Text ``Styles'' 1 Apr 2021 · 0 repositories
-
Dynamic Graph Transformer for Implicit Tag Recognition 1 Apr 2021 · 0 repositories
-
Enriching Non-Autoregressive Transformer with Syntactic and Semantic Structures for Neural Machine Translation 1 Apr 2021 · 0 repositories
-
InterpreT: An Interactive Visualization Tool for Interpreting Transformers 1 Apr 2021 · 0 repositories
-
Keyword Transformer: A Self-Attention Model for Keyword Spotting 1 Apr 2021 · 10 repositories · arXiv:2104.00769Syntology community repositories only · 14 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples)
-
LoFTR: Detector-Free Local Feature Matching with Transformers 1 Apr 2021 · 4 repositories · arXiv:2104.00680Syntology official (archive's flag): 4 ran · 14 ran (of which 6 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 3 pointer-only (licence)
-
Next Generation Multitarget Trackers: Random Finite Set Methods vs Transformer-based Deep Learning 1 Apr 2021 · 1 repository · arXiv:2104.00734
-
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis 1 Apr 2021 · 2 repositories · arXiv:2104.00677Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking 1 Apr 2021 · 0 repositories · arXiv:2104.00194
-
WakaVT: A Sequential Variational Transformer for Waka Generation 1 Apr 2021 · 0 repositories · arXiv:2104.00426
-
A Neighbourhood Framework for Resource-Lean Content Flagging 31 Mar 2021 · 0 repositories · arXiv:2103.17055
-
Adversarial Attacks and Defenses for Speech Recognition Systems 31 Mar 2021 · 0 repositories · arXiv:2103.17122
-
Learning Spatio-Temporal Transformer for Visual Tracking 31 Mar 2021 · 1 repository · arXiv:2103.17154Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
Read and Attend: Temporal Localisation in Sign Language Videos 30 Mar 2021 · 0 repositories · arXiv:2103.16481
-
Rethinking Spatial Dimensions of Vision Transformers 30 Mar 2021 · 12 repositories · arXiv:2103.16302Syntology official: harvested, nothing ran · 10 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (of 20 harvested samples)
-
Spatiotemporal Transformer for Video-based Person Re-identification 30 Mar 2021 · 0 repositories · arXiv:2103.16469
-
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding 29 Mar 2021 · 3 repositories · arXiv:2103.15358Syntology official (archive's flag): 3 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 2 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
Transformer Tracking 29 Mar 2021 · 1 repository · arXiv:2103.15436Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
CvT: Introducing Convolutions to Vision Transformers 29 Mar 2021 · 16 repositories · arXiv:2103.15808Syntology official (archive's flag): 10 ran · 39 ran (of which 19 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified (of 47 harvested samples) · 8 pointer-only (licence)
-
HiT: Hierarchical Transformer with Momentum Contrast for Video-Text Retrieval 28 Mar 2021 · 0 repositories · arXiv:2103.15049
-
PENELOPIE: Enabling Open Information Extraction for the Greek Language through Machine Translation 28 Mar 2021 · 1 repository · arXiv:2103.15075
-
Face Transformer for Recognition 27 Mar 2021 · 2 repositories · arXiv:2103.14803Syntology official (archive's flag): 4 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 2 pointer-only (licence)
-
A Practical Survey on Faster and Lighter Transformers 26 Mar 2021 · 0 repositories · arXiv:2103.14636