Methods › General › Feedforward Networks › Position-Wise Feed-Forward Layer › Papers, page 108
Position-Wise Feed-Forward Layer
Papers archive 2025-07-28
archive papers tagged: 13,895 · with a code link: 6,514 · where Syntology ran a sample: 2,229 (1,902 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,229 of 13,895 tagged: 1,902 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 108 of 139: papers 10,701 to 10,800 of 13,895, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Wearable Sensor-Based Human Activity Recognition with Transformer Model 1 Mar 2022 · 1 repository
-
A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmark 28 Feb 2022 · 2 repositories · arXiv:2203.00131Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising 28 Feb 2022 · 2 repositories · arXiv:2202.13517
-
DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training 28 Feb 2022 · 1 repository · arXiv:2202.13808
-
Filter-enhanced MLP is All You Need for Sequential Recommendation 28 Feb 2022 · 2 repositories · arXiv:2202.13556
-
LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding 28 Feb 2022 · 5 repositories · arXiv:2202.13669Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
LISA: Learning Interpretable Skill Abstractions from Language 28 Feb 2022 · 1 repository · arXiv:2203.00054
-
SUNet: Swin Transformer UNet for Image Denoising 28 Feb 2022 · 2 repositories · arXiv:2202.14009
-
DXM-TransFuse U-net: Dual Cross-Modal Transformer Fusion U-net for Automated Nerve Identification 27 Feb 2022 · 0 repositories · arXiv:2202.13304
-
Spatial-Temporal Attention Fusion Network for short-term passenger flow prediction on holidays in urban rail transit systems 27 Feb 2022 · 0 repositories · arXiv:2203.00007
-
Short-term passenger flow prediction for multi-traffic modes: A Transformer and residual network based multi-task learning method 27 Feb 2022 · 0 repositories · arXiv:2203.00422
-
An End-to-End Transformer Model for Crowd Localization 26 Feb 2022 · 1 repository · arXiv:2202.13065
-
Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors 26 Feb 2022 · 2 repositories · arXiv:2202.13142
-
A Hardware-Aware System for Accelerating Deep Neural Network Optimization 25 Feb 2022 · 0 repositories · arXiv:2202.12954
-
Self-Supervised and Interpretable Anomaly Detection using Network Transformers 25 Feb 2022 · 0 repositories · arXiv:2202.12997
-
Instantaneous Physiological Estimation using Video Transformers 24 Feb 2022 · 1 repository · arXiv:2202.12368
-
openFEAT: Improving Speaker Identification by Open-set Few-shot Embedding Adaptation with Transformer 24 Feb 2022 · 0 repositories · arXiv:2202.12349
-
Transformers in Medical Image Analysis: A Review 24 Feb 2022 · 0 repositories · arXiv:2202.12165
-
A Differential Attention Fusion Model Based on Transformer for Time Series Forecasting 23 Feb 2022 · 0 repositories · arXiv:2202.11402
-
FastRPB: a Scalable Relative Positional Encoding for Long Sequence Tasks 23 Feb 2022 · 1 repository · arXiv:2202.11364
-
Paying U-Attention to Textures: Multi-Stage Hourglass Vision Transformer for Universal Texture Synthesis 23 Feb 2022 · 0 repositories · arXiv:2202.11703
-
Refining the state-of-the-art in Machine Translation, optimizing NMT for the JA <-> EN language pair by leveraging personal domain expertise 23 Feb 2022 · 0 repositories · arXiv:2202.11669
-
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation 23 Feb 2022 · 1 repository · arXiv:2202.11742Syntology 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers 22 Feb 2022 · 0 repositories · arXiv:2202.11176
-
GroupViT: Semantic Segmentation Emerges from Text Supervision 22 Feb 2022 · 6 repositories · arXiv:2202.11094
-
One-shot Scene Graph Generation 22 Feb 2022 · 1 repository · arXiv:2202.10824
-
Social Computational Design Method for Generating Product Shapes with GAN and Transformer Models 22 Feb 2022 · 0 repositories · arXiv:2202.10774
-
Socialformer: Social Network Inspired Long Document Modeling for Document Ranking 22 Feb 2022 · 1 repository · arXiv:2202.10870
-
Embarrassingly Simple Performance Prediction for Abductive Natural Language Inference 21 Feb 2022 · 1 repository · arXiv:2202.10408
-
Formal Analysis of the Sampling Behaviour of Stochastic Event-Triggered Control 21 Feb 2022 · 0 repositories · arXiv:2202.10178
-
Rethinking the Zigzag Flattening for Image Reading 21 Feb 2022 · 0 repositories · arXiv:2202.10240
-
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification 21 Feb 2022 · 1 repository · arXiv:2202.10139
-
ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond 21 Feb 2022 · 8 repositories · arXiv:2202.10108Syntology community repositories only · 22 ran (of which 8 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 0 violated, 16 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 25 harvested samples) · 4 pointer-only (licence)
-
ARM3D: Attention-based relation module for indoor 3D object detection 20 Feb 2022 · 1 repository · arXiv:2202.09715
-
Do Transformers know symbolic rules, and would we know if they did? 19 Feb 2022 · 0 repositories · arXiv:2203.00162
-
TransDreamer: Reinforcement Learning with Transformer World Models 19 Feb 2022 · 0 repositories · arXiv:2202.09481Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
A Survey of Vision-Language Pre-Trained Models 18 Feb 2022 · 0 repositories · arXiv:2202.10936
-
Mixture-of-Experts with Expert Choice Routing 18 Feb 2022 · 0 repositories · arXiv:2202.09368
-
Task Specific Attention is one more thing you need for object detection 18 Feb 2022 · 1 repository · arXiv:2202.09048
-
Unleashing the Power of Transformer for Graphs 18 Feb 2022 · 0 repositories · arXiv:2202.10581
-
Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment 17 Feb 2022 · 0 repositories · arXiv:2202.08510
-
ST-MoE: Designing Stable and Transferable Sparse Expert Models 17 Feb 2022 · 3 repositories · arXiv:2202.08906Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
Graph Masked Autoencoders with Transformers 17 Feb 2022 · 1 repository · arXiv:2202.08391
-
Improving English to Sinhala Neural Machine Translation using Part-of-Speech Tag 17 Feb 2022 · 0 repositories · arXiv:2202.08882
-
Revisiting Over-smoothing in BERT from the Perspective of Graph 17 Feb 2022 · 0 repositories · arXiv:2202.08625
-
Transformer for Graphs: An Overview from Architecture Perspective 17 Feb 2022 · 1 repository · arXiv:2202.08455Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgery 17 Feb 2022 · 0 repositories · arXiv:2202.08453
-
ActionFormer: Localizing Moments of Actions with Transformers 16 Feb 2022 · 1 repository · arXiv:2202.07925
-
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation 16 Feb 2022 · 1 repository · arXiv:2202.07959Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
The NLP Task Effectiveness of Long-Range Transformers 16 Feb 2022 · 0 repositories · arXiv:2202.07856
-
A Survey on Dynamic Neural Networks for Natural Language Processing 15 Feb 2022 · 0 repositories · arXiv:2202.07101
-
A Survey on Model Compression and Acceleration for Pretrained Language Models 15 Feb 2022 · 0 repositories · arXiv:2202.07105
-
Personalized Prompt Learning for Explainable Recommendation 15 Feb 2022 · 1 repository · arXiv:2202.07371
-
Transformers in Time Series: A Survey 15 Feb 2022 · 11 repositories · arXiv:2202.07125
-
ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer 15 Feb 2022 · 0 repositories · arXiv:2202.07305
-
XAI for Transformers: Better Explanations through Conservative Propagation 15 Feb 2022 · 1 repository · arXiv:2202.07304Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples)
-
CodeFill: Multi-token Code Completion by Jointly Learning from Structure and Naming Sequences 14 Feb 2022 · 1 repository · arXiv:2202.06689
-
Geometric Transformer for Fast and Robust Point Cloud Registration 14 Feb 2022 · 2 repositories · arXiv:2202.06688Syntology community repositories only · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 9 harvested samples) · 9 pointer-only (licence)
-
Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Images 14 Feb 2022 · 1 repository · arXiv:2202.07001Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs 14 Feb 2022 · 2 repositories · arXiv:2202.06510Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 6 pointer-only (licence)
-
Source Code Summarization with Structural Relative Position Guided Transformer 14 Feb 2022 · 1 repository · arXiv:2202.06521
-
Transformer Memory as a Differentiable Search Index 14 Feb 2022 · 1 repository · arXiv:2202.06991
-
What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code 14 Feb 2022 · 1 repository · arXiv:2202.06840
-
BViT: Broad Attention based Vision Transformer 13 Feb 2022 · 1 repository · arXiv:2202.06268
-
ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification 13 Feb 2022 · 1 repository · arXiv:2202.06335
-
LighTN: Light-weight Transformer Network for Performance-overhead Tradeoff in Point Cloud Downsampling 13 Feb 2022 · 0 repositories · arXiv:2202.06263
-
LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition 13 Feb 2022 · 0 repositories · arXiv:2203.03546
-
Benchmark Assessment for DeepSpeed Optimization Library 12 Feb 2022 · 0 repositories · arXiv:2202.12831
-
Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval 12 Feb 2022 · 1 repository · arXiv:2202.06014
-
Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval 12 Feb 2022 · 1 repository
-
Including Facial Expressions in Contextual Embeddings for Sign Language Generation 11 Feb 2022 · 0 repositories · arXiv:2202.05383
-
AA-TransUNet: Attention Augmented TransUNet For Nowcasting Tasks 10 Feb 2022 · 1 repository · arXiv:2202.04996
-
The Volcspeech system for the ICASSP 2022 multi-channel multi-party meeting transcription challenge 9 Feb 2022 · 0 repositories · arXiv:2202.04261
-
CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations 8 Feb 2022 · 0 repositories · arXiv:2202.03587
-
Efficacy of Transformer Networks for Classification of Raw EEG Data 8 Feb 2022 · 0 repositories · arXiv:2202.05170
-
Particle Transformer for Jet Tagging 8 Feb 2022 · 1 repository · arXiv:2202.03772Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language 7 Feb 2022 · 12 repositories · arXiv:2202.03555Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)
-
Efficient Adapter Transfer of Self-Supervised Speech Models for Automatic Speech Recognition 7 Feb 2022 · 1 repository · arXiv:2202.03218Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
Recent Trends in 2D Object Detection and Applications in Video Event Recognition 7 Feb 2022 · 0 repositories · arXiv:2202.03206
-
Structure-Aware Transformer for Graph Representation Learning 7 Feb 2022 · 3 repositories · arXiv:2202.03036Syntology official (archive's flag): 2 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
User Satisfaction Estimation with Sequential Dialogue Act Modeling in Goal-oriented Conversational Systems 7 Feb 2022 · 1 repository · arXiv:2202.02912
-
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models 6 Feb 2022 · 1 repository · arXiv:2202.02664Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Exploring Self-Attention Mechanisms for Speech Separation 6 Feb 2022 · 1 repository · arXiv:2202.02884
-
Pre-Trained Neural Language Models for Automatic Mobile App User Feedback Answer Generation 4 Feb 2022 · 0 repositories · arXiv:2202.02294
-
Supervised Contrastive Learning for Product Matching 4 Feb 2022 · 1 repository · arXiv:2202.02098
-
TransFollower: Long-Sequence Car-Following Trajectory Prediction through Transformer 4 Feb 2022 · 0 repositories · arXiv:2202.03183
-
Brain Cancer Survival Prediction on Treatment-na ive MRI using Deep Anchor Attention Learning with Vision Transformer 3 Feb 2022 · 0 repositories · arXiv:2202.01857
-
ETSformer: Exponential Smoothing Transformers for Time-series Forecasting 3 Feb 2022 · 3 repositories · arXiv:2202.01381Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
Exploring Transformer Backbones for Heterogeneous Treatment Effect Estimation 2 Feb 2022 · 1 repository · arXiv:2202.01336Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
AlphaDesign: A graph protein design method and benchmark on AlphaFoldDB 1 Feb 2022 · 1 repository · arXiv:2202.01079
-
LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data 1 Feb 2022 · 1 repository · arXiv:2202.00185Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)
-
Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classification 1 Feb 2022 · 1 repository · arXiv:2202.00395Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Local Feature Matching with Transformers for low-end devices 1 Feb 2022 · 1 repository · arXiv:2202.00770
-
Regression Transformer: Concurrent sequence regression and generation for molecular language modeling 1 Feb 2022 · 1 repository · arXiv:2202.01338Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)
-
Transformer-based Models of Text Normalization for Speech Applications 1 Feb 2022 · 0 repositories · arXiv:2202.00153
-
BOAT: Bilateral Local Attention Vision Transformer 31 Jan 2022 · 1 repository · arXiv:2201.13027
-
Fast Monte-Carlo Approximation of the Attention Mechanism 30 Jan 2022 · 0 repositories · arXiv:2201.12854
-
FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting 30 Jan 2022 · 3 repositories · arXiv:2201.12740Syntology community repositories only · 14 ran (of which 8 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples)
-
GRPE: Relative Positional Encoding for Graph Transformer 30 Jan 2022 · 1 repository · arXiv:2201.12787Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting 30 Jan 2022 · 4 repositories · arXiv:2201.12886Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)