Methods › General › Feedforward Networks › Position-Wise Feed-Forward Layer › Papers, page 124
Position-Wise Feed-Forward Layer
Papers archive 2025-07-28
archive papers tagged: 13,895 · with a code link: 6,514 · where Syntology ran a sample: 2,229 (1,902 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2,229 of 13,895 tagged: 1,902 with a run with no instrument failure, 327 where every run was a failure of Syntology's instrument)
Page 124 of 139: papers 12,301 to 12,400 of 13,895, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Transformer Language Models with LSTM-based Cross-utterance Information Representation 12 Feb 2021 · 1 repository · arXiv:2102.06474
-
Proof Artifact Co-training for Theorem Proving with Language Models 11 Feb 2021 · 4 repositories · arXiv:2102.06203Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
Text Compression-aided Transformer Encoding 11 Feb 2021 · 0 repositories · arXiv:2102.05951
-
NAST: Non-Autoregressive Spatial-Temporal Transformer for Time Series Forecasting 10 Feb 2021 · 1 repository · arXiv:2102.05624
-
Bayesian Transformer Language Models for Speech Recognition 9 Feb 2021 · 0 repositories · arXiv:2102.04754
-
Conversational Query Rewriting with Self-supervised Learning 9 Feb 2021 · 0 repositories · arXiv:2102.04708
-
Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks 9 Feb 2021 · 0 repositories · arXiv:2102.04610
-
Point Cloud Transformers applied to Collider Physics 9 Feb 2021 · 1 repository · arXiv:2102.05073
-
Colorization Transformer 8 Feb 2021 · 2 repositories · arXiv:2102.04432
-
TransReID: Transformer-based Object Re-Identification 8 Feb 2021 · 4 repositories · arXiv:2102.04378
-
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation 8 Feb 2021 · 22 repositories · arXiv:2102.04306Syntology official: no sample here; runs from other or unrecorded repositories · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
Wake Word Detection with Streaming Transformers 8 Feb 2021 · 0 repositories · arXiv:2102.04488
-
Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention 7 Feb 2021 · 10 repositories · arXiv:2102.03902Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
baller2vec: A Multi-Entity Transformer For Multi-Agent Spatiotemporal Modeling 5 Feb 2021 · 1 repository · arXiv:2102.03291Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Transformers 5 Feb 2021 · 1 repository · arXiv:2102.03161Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision 5 Feb 2021 · 6 repositories · arXiv:2102.03334Syntology official: harvested, nothing ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result (of 4 harvested samples) · 1 pointer-only (licence)
-
MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records 3 Feb 2021 · 0 repositories · arXiv:2102.02340
-
Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysis 3 Feb 2021 · 0 repositories · arXiv:2102.02111
-
Mind the Gap: Assessing Temporal Generalization in Neural Language Models 3 Feb 2021 · 1 repository · arXiv:2102.01951
-
Relaxed Transformer Decoders for Direct Action Proposal Generation 3 Feb 2021 · 2 repositories · arXiv:2102.01894Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Towards Natural and Controllable Cross-Lingual Voice Conversion Based on Neural TTS Model and Phonetic Posteriorgram 3 Feb 2021 · 0 repositories · arXiv:2102.01991
-
Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow 1 Feb 2021 · 1 repository · arXiv:2102.00826
-
GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer 1 Feb 2021 · 0 repositories · arXiv:2102.00769
-
A Runtime-Based Computational Performance Predictor for Deep Neural Network Training 31 Jan 2021 · 1 repository · arXiv:2102.00527
-
Short Text Clustering with Transformers 31 Jan 2021 · 0 repositories · arXiv:2102.00541
-
Enhancing the Transformer Decoder with Transition-based Syntax 29 Jan 2021 · 1 repository · arXiv:2101.12640
-
LSTM-SAKT: LSTM-Encoded SAKT-like Transformer for Knowledge Tracing 28 Jan 2021 · 0 repositories · arXiv:2102.00845
-
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet 28 Jan 2021 · 13 repositories · arXiv:2101.11986Syntology official (archive's flag): 4 ran · 21 ran (of which 16 constructed an object rather than computing a result; 21 with no instrument failure: 1 honoured, 0 violated, 20 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 26 harvested samples) · 8 pointer-only (licence)
-
An explainable Transformer-based deep learning model for the prediction of incident heart failure 27 Jan 2021 · 0 repositories · arXiv:2101.11359
-
Exploring multi-task multi-lingual learning of transformer models for hate speech and offensive speech identification in social media 27 Jan 2021 · 1 repository · arXiv:2101.11155
-
Spatial-Channel Transformer Network for Trajectory Prediction on the Traffic Scenes 27 Jan 2021 · 0 repositories · arXiv:2101.11472
-
Attention Can Reflect Syntactic Structure (If You Let It) 26 Jan 2021 · 0 repositories · arXiv:2101.10927
-
CPTR: Full Transformer Network for Image Captioning 26 Jan 2021 · 0 repositories · arXiv:2101.10804
-
The Wireless Control Bus: Enabling Efficient Multi-hop Event-Triggered Control with Concurrent Transmissions 26 Jan 2021 · 0 repositories · arXiv:2101.10961
-
Randomized Deep Structured Prediction for Discourse-Level Processing 25 Jan 2021 · 0 repositories · arXiv:2101.10435
-
Multi-Task Time Series Forecasting With Shared Attention 24 Jan 2021 · 0 repositories · arXiv:2101.09645
-
Towards a Better Integration of Fuzzy Matches in Neural Machine Translation through Data Augmentation 24 Jan 2021 · 1 repository
-
Enriching Non-Autoregressive Transformer with Syntactic and SemanticStructures for Neural Machine Translation 22 Jan 2021 · 0 repositories · arXiv:2101.08942
-
Activity Graph Transformer for Temporal Action Localization 21 Jan 2021 · 0 repositories · arXiv:2101.08540
-
DAF:re: A Challenging, Crowd-Sourced, Large-Scale, Long-Tailed Dataset For Anime Character Recognition 21 Jan 2021 · 2 repositories · arXiv:2101.08674Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval 21 Jan 2021 · 1 repository · arXiv:2101.08370Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ 21 Jan 2021 · 1 repository · arXiv:2101.08779
-
Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates 20 Jan 2021 · 0 repositories · arXiv:2101.08133
-
Open-Domain Conversational Search Assistant with Transformers 20 Jan 2021 · 1 repository · arXiv:2101.08197
-
PGT: Pseudo Relevance Feedback Using a Graph-Based Transformer 20 Jan 2021 · 1 repository · arXiv:2101.07918
-
UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers 20 Jan 2021 · 1 repository · arXiv:2101.08001
-
Fast Convergence of DETR with Spatially Modulated Co-Attention 19 Jan 2021 · 2 repositories · arXiv:2101.07448Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Dual-Level Collaborative Transformer for Image Captioning 16 Jan 2021 · 1 repository · arXiv:2101.06462
-
Match-Ignition: Plugging PageRank into Transformer for Long-form Text Matching 16 Jan 2021 · 1 repository · arXiv:2101.06423
-
Exploration of Visual Features and their weighted-additive fusion for Video Captioning 14 Jan 2021 · 0 repositories · arXiv:2101.05806
-
Training Data Leakage Analysis in Language Models 14 Jan 2021 · 0 repositories · arXiv:2101.05405
-
Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings 13 Jan 2021 · 1 repository · arXiv:2101.04998
-
Neural News Recommendation with Negative Feedback 12 Jan 2021 · 0 repositories · arXiv:2101.04328
-
BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer 11 Jan 2021 · 0 repositories · arXiv:2101.04158
-
Investigating the Vision Transformer Model for Image Retrieval Tasks 11 Jan 2021 · 0 repositories · arXiv:2101.03771
-
Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection 11 Jan 2021 · 1 repository · arXiv:2101.03778
-
Spherical Transformer: Adapting Spherical Signal to CNNs 11 Jan 2021 · 0 repositories · arXiv:2101.03848
-
Channel Boosting Feature Ensemble for Radar-based Object Detection 10 Jan 2021 · 0 repositories · arXiv:2101.03531
-
Deep Reinforcement Learning with Function Properties in Mean Reversion Strategies 9 Jan 2021 · 1 repository · arXiv:2101.03418
-
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing 9 Jan 2021 · 1 repository · arXiv:2101.03289
-
Leveraging Multilingual Transformers for Hate Speech Detection 8 Jan 2021 · 1 repository · arXiv:2101.03207
-
Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs 7 Jan 2021 · 5 repositories · arXiv:2101.02402Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples)
-
TrackFormer: Multi-Object Tracking with Transformers 7 Jan 2021 · 2 repositories · arXiv:2101.02702
-
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks 5 Jan 2021 · 1 repository · arXiv:2101.01761
-
I-BERT: Integer-only BERT Quantization 5 Jan 2021 · 7 repositories · arXiv:2101.01321
-
Improving Portuguese Semantic Role Labeling with Transformers and Transfer Learning 4 Jan 2021 · 1 repository · arXiv:2101.01213
-
Transformers in Vision: A Survey 4 Jan 2021 · 0 repositories · arXiv:2101.01169
-
An Efficient Transformer Decoder with Compressed Sub-layers 3 Jan 2021 · 0 repositories · arXiv:2101.00542
-
Analogical Reasoning for Visually Grounded Compositional Generalization 1 Jan 2021 · 0 repositories
-
AriEL: Volume Coding for Sentence Generation Comparisons 1 Jan 2021 · 0 repositories
-
Attention Is Not Enough: Mitigating the Distribution Discrepancy in Asynchronous Multimodal Sequence Fusion 1 Jan 2021 · 0 repositories
-
Block Skim Transformer for Efficient Question Answering 1 Jan 2021 · 0 repositories
-
Cluster-Former: Clustering-based Sparse Transformer for Question Answering 1 Jan 2021 · 0 repositories
-
CrackFormer: Transformer Network for Fine-Grained Crack Detection 1 Jan 2021 · 1 repository
-
Deep Representational Re-tuning using Contrastive Tension 1 Jan 2021 · 1 repository
-
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection 1 Jan 2021 · 0 repositories
-
Do Transformers Understand Polynomial Simplification? 1 Jan 2021 · 0 repositories
-
Dynamic DETR: End-to-End Object Detection With Dynamic Attention 1 Jan 2021 · 0 repositories
-
Event-Based Video Reconstruction Using Transformer 1 Jan 2021 · 1 repository
-
Exploring Routing Strategies for Multilingual Mixture-of-Experts Models 1 Jan 2021 · 0 repositories
-
Frequency-Aware Spatiotemporal Transformers for Video Inpainting Detection 1 Jan 2021 · 0 repositories
-
Generalizing Tree Models for Improving Prediction Accuracy 1 Jan 2021 · 0 repositories
-
High-Performance Discriminative Tracking With Transformers 1 Jan 2021 · 0 repositories
-
HyperGrid Transformers: Towards A Single Model for Multiple Tasks 1 Jan 2021 · 0 repositories
-
Image Harmonization With Transformer 1 Jan 2021 · 1 repository
-
Improving Generalizability of Protein Sequence Models via Data Augmentations 1 Jan 2021 · 0 repositories
-
Improving Machine Translation by Searching Skip Connections Efficiently 1 Jan 2021 · 0 repositories
-
KETG: A Knowledge Enhanced Text Generation Framework 1 Jan 2021 · 0 repositories
-
Long Range Arena : A Benchmark for Efficient Transformers 1 Jan 2021 · 0 repositories
-
Memory Representation in Transformer 1 Jan 2021 · 0 repositories
-
Multi-View 3D Reconstruction With Transformers 1 Jan 2021 · 0 repositories
-
Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images 1 Jan 2021 · 1 repository
-
Non-iterative Parallel Text Generation via Glancing Transformer 1 Jan 2021 · 0 repositories
-
On Position Embeddings in BERT 1 Jan 2021 · 0 repositories
-
Parameterization of Hypercomplex Multiplications 1 Jan 2021 · 0 repositories
-
PhraseTransformer: Self-Attention using Local Context for Semantic Parsing 1 Jan 2021 · 1 repository
-
Post-Training Weighted Quantization of Neural Networks for Language Models 1 Jan 2021 · 0 repositories
-
Predictive Attention Transformer: Improving Transformer with Attention Map Prediction 1 Jan 2021 · 0 repositories
-
Representation and Bias in Multilingual NLP: Insights from Controlled Experiments on Conditional Language Modeling 1 Jan 2021 · 0 repositories
-
Representational correlates of hierarchical phrase structure in deep language models 1 Jan 2021 · 0 repositories