Methods › General › Attention Mechanisms › Attention › Papers, page 216

Attention Is All You Need

Attention

Papers archive 2025-07-28

archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,366 with a run with no instrument failure, 632 where every run was a failure of Syntology's instrument)

Page 216 of 316: papers 21,501 to 21,600 of 31,583, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentation
  17 Jan 2023 · 0 repositories · arXiv:2301.06869
• SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Network
  17 Jan 2023 · 1 repository · arXiv:2301.06715
• Tracing and Manipulating Intermediate Values in Neural Math Problem Solvers
  17 Jan 2023 · 1 repository · arXiv:2301.06758
• Transformer Based Implementation for Automatic Book Summarization
  17 Jan 2023 · 0 repositories · arXiv:2301.07057
• An Error-Guided Correction Model for Chinese Spelling Error Correction
  16 Jan 2023 · 1 repository · arXiv:2301.06323
• BayesSpeech: A Bayesian Transformer Network for Automatic Speech Recognition
  16 Jan 2023 · 0 repositories · arXiv:2301.11276
• Improving Target Speaker Extraction with Sparse LDA-transformed Speaker Embeddings
  16 Jan 2023 · 0 repositories · arXiv:2301.06277
• A Transformer-based Diffusion Probabilistic Model for Heart Rate and Blood Pressure Forecasting in Intensive Care Unit
  16 Jan 2023 · 1 repository · arXiv:2301.06625
• TEDB System Description to a Shared Task on Euphemism Detection 2022
  16 Jan 2023 · 1 repository · arXiv:2301.06602
• DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets
  15 Jan 2023 · 4 repositories · arXiv:2301.06051
• Improving Noise Robustness for Spoken Content Retrieval using Semi-supervised ASR and N-best Transcripts for BERT-based Ranking Models
  15 Jan 2023 · 0 repositories · arXiv:2301.06056
• T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations
  15 Jan 2023 · 1 repository · arXiv:2301.06052
  Syntology official (archive's flag): 5 ran · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
• Salient Sign Detection In Safe Autonomous Driving: AI Which Reasons Over Full Visual Context
  14 Jan 2023 · 0 repositories · arXiv:2301.05804
• Automated speech- and text-based classification of neuropsychiatric conditions in a multidiagnostic setting
  13 Jan 2023 · 0 repositories · arXiv:2301.06916
• Efficient Activation Function Optimization through Surrogate Modeling
  13 Jan 2023 · 2 repositories · arXiv:2301.05785
  Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Text to Point Cloud Localization with Relation-Enhanced Transformer
  13 Jan 2023 · 0 repositories · arXiv:2301.05372
• Adversarial Adaptation for French Named Entity Recognition
  12 Jan 2023 · 1 repository · arXiv:2301.05220
• ViTs for SITS: Vision Transformers for Satellite Image Time Series
  12 Jan 2023 · 3 repositories · arXiv:2301.04944
  Syntology official (archive's flag): 3 ran · 11 ran (of which 3 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples)
• AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformers
  11 Jan 2023 · 1 repository · arXiv:2301.04545
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 3 pointer-only (licence)
• Anomalies, Representations, and Self-Supervision
  11 Jan 2023 · 0 repositories · arXiv:2301.04660
• Super-resolution of Ray-tracing Channel Simulation via Attention Mechanism based Deep Learning Model
  11 Jan 2023 · 0 repositories · arXiv:2301.04479
• Dynamic Background Reconstruction via MAE for Infrared Small Target Detection
  11 Jan 2023 · 0 repositories · arXiv:2301.04497
• GPT as Knowledge Worker: A Zero-Shot Evaluation of (AI)CPA Capabilities
  11 Jan 2023 · 1 repository · arXiv:2301.04408
• Head-Free Lightweight Semantic Segmentation with Linear Transformer
  11 Jan 2023 · 1 repository · arXiv:2301.04648
• NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
  11 Jan 2023 · 1 repository · arXiv:2301.04761
  Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Topics in Contextualised Attention Embeddings
  11 Jan 2023 · 0 repositories · arXiv:2301.04339
• Dynamic Grained Encoder for Vision Transformers
  10 Jan 2023 · 1 repository · arXiv:2301.03831
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 5 pointer-only (licence)
• Language Models sounds the Death Knell of Knowledge Graphs
  10 Jan 2023 · 0 repositories · arXiv:2301.03980
• Predicting Hateful Discussions on Reddit using Graph Transformer Networks and Communal Context
  10 Jan 2023 · 1 repository · arXiv:2301.04248
• Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Models
  10 Jan 2023 · 0 repositories · arXiv:2301.03797
• Streaming Punctuation: A Novel Punctuation Technique Leveraging Bidirectional Context for Continuous Speech Recognition
  10 Jan 2023 · 0 repositories · arXiv:2301.03819
• There is No Big Brother or Small Brother: Knowledge Infusion in Language Models for Link Prediction and Question Answering
  10 Jan 2023 · 2 repositories · arXiv:2301.04013
• Unsupervised Mandarin-Cantonese Machine Translation
  10 Jan 2023 · 1 repository · arXiv:2301.03971
• A Study on the Generality of Neural Network Structures for Monocular Depth Estimation
  9 Jan 2023 · 1 repository · arXiv:2301.03169
• Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review
  9 Jan 2023 · 1 repository · arXiv:2301.03505
• An Impartial Transformer for Story Visualization
  9 Jan 2023 · 0 repositories · arXiv:2301.03563
• DeMT: Deformable Mixer Transformer for Multi-Task Learning of Dense Prediction
  9 Jan 2023 · 1 repository · arXiv:2301.03461
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
  9 Jan 2023 · 2 repositories · arXiv:2301.03580
  Syntology official (archive's flag): 9 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 2 pointer-only (licence)
• Logically at Factify 2: A Multi-Modal Fact Checking System Based on Evidence Retrieval techniques and Transformer Encoder Architecture
  9 Jan 2023 · 0 repositories · arXiv:2301.03127
• Online Fake Review Detection Using Supervised Machine Learning And BERT Model
  9 Jan 2023 · 0 repositories · arXiv:2301.03225
• Universal Multimodal Representation for Language Understanding
  9 Jan 2023 · 0 repositories · arXiv:2301.03344
• Automatic Generation of German Drama Texts Using Fine Tuned GPT-2 Models
  8 Jan 2023 · 0 repositories · arXiv:2301.03119
• DeepMatcher: A Deep Transformer-based Network for Robust and Accurate Local Feature Matching
  8 Jan 2023 · 1 repository · arXiv:2301.02993
• HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection
  8 Jan 2023 · 1 repository · arXiv:2301.03036
• App Review Driven Collaborative Bug Finding
  7 Jan 2023 · 1 repository · arXiv:2301.02818
• RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
  7 Jan 2023 · 0 repositories · arXiv:2301.02807
• CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
  6 Jan 2023 · 1 repository · arXiv:2301.02379
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 13 harvested samples)
• Generative Antibody Design for Complementary Chain Pairing Sequences through Encoder-Decoder Language Model
  6 Jan 2023 · 0 repositories · arXiv:2301.02748
• Does compressing activations help model parallel training?
  6 Jan 2023 · 0 repositories · arXiv:2301.02654
• Exploring Efficient Few-shot Adaptation for Vision Transformers
  6 Jan 2023 · 1 repository · arXiv:2301.02419
• Multi-Genre Music Transformer -- Composing Full Length Musical Piece
  6 Jan 2023 · 0 repositories · arXiv:2301.02385
• Systems for Parallel and Distributed Large-Model Deep Learning Training
  6 Jan 2023 · 0 repositories · arXiv:2301.02691
• Adaptive Pattern Extraction Multi-Task Learning for Multi-Step Conversion Estimations
  6 Jan 2023 · 0 repositories · arXiv:2301.02494
• Adaptively Clustering Neighbor Elements for Image-Text Generation
  5 Jan 2023 · 1 repository · arXiv:2301.01955
• CAT: LoCalization and IdentificAtion Cascade Detection Transformer for Open-World Object Detection
  5 Jan 2023 · 0 repositories · arXiv:2301.01970
• Critical Perspectives: A Benchmark Revealing Pitfalls in PerspectiveAPI
  5 Jan 2023 · 1 repository · arXiv:2301.01874
• Enabling Augmented Segmentation and Registration in Ultrasound-Guided Spinal Surgery via Realistic Ultrasound Synthesis from Diagnostic CT Volume
  5 Jan 2023 · 0 repositories · arXiv:2301.01940
• Learning Feature Recovery Transformer for Occluded Person Re-identification
  5 Jan 2023 · 1 repository · arXiv:2301.01879
• Learning Trajectory-Word Alignments for Video-Language Tasks
  5 Jan 2023 · 0 repositories · arXiv:2301.01953
• Single-round Self-supervised Distributed Learning using Vision Transformer
  5 Jan 2023 · 0 repositories · arXiv:2301.02064
• Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanism
  5 Jan 2023 · 0 repositories · arXiv:2301.01919
• Sequentially Controlled Text Generation
  5 Jan 2023 · 0 repositories · arXiv:2301.02299
• Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofs
  5 Jan 2023 · 1 repository · arXiv:2301.02195
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
• Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distribution
  5 Jan 2023 · 1 repository · arXiv:2301.02068
• Extending Source Code Pre-Trained Language Models to Summarise Decompiled Binaries
  4 Jan 2023 · 1 repository · arXiv:2301.01701
• Infomaxformer: Maximum Entropy Transformer for Long Time-Series Forecasting Problem
  4 Jan 2023 · 0 repositories · arXiv:2301.01772
• InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrieval
  4 Jan 2023 · 1 repository · arXiv:2301.01820
• Multi-Aspect Explainable Inductive Relation Prediction by Sentence Transformer
  4 Jan 2023 · 1 repository · arXiv:2301.01664
• Semi-MAE: Masked Autoencoders for Semi-supervised Vision Transformers
  4 Jan 2023 · 0 repositories · arXiv:2301.01431
• SPTS v2: Single-Point Scene Text Spotting
  4 Jan 2023 · 3 repositories · arXiv:2301.01635
  Syntology official (archive's flag): 15 ran · 15 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 1 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 16 harvested samples) · 3 pointer-only (licence)
• UniHD at TSAR-2022 Shared Task: Is Compute All We Need for Lexical Simplification?
  4 Jan 2023 · 1 repository · arXiv:2301.01764
• A New Perspective to Boost Vision Transformer for Medical Image Classification
  3 Jan 2023 · 0 repositories · arXiv:2301.00989
• Cross Modal Transformer: Towards Fast and Robust 3D Object Detection
  3 Jan 2023 · 2 repositories · arXiv:2301.01283
• Detecting Severity of Diabetic Retinopathy from Fundus Images: A Transformer Network-based Review
  3 Jan 2023 · 0 repositories · arXiv:2301.00973
• Large Language Models as Corporate Lobbyists
  3 Jan 2023 · 1 repository · arXiv:2301.01181
• Medical Image Segmentation via Cascaded Attention Decoding
  3 Jan 2023 · 1 repository
• Modeling the Rhythm from Lyrics for Melody Generation of Pop Song
  3 Jan 2023 · 0 repositories · arXiv:2301.01361
• PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora
  3 Jan 2023 · 0 repositories · arXiv:2301.01064
• Rethinking Mobile Block for Efficient Attention-based Models
  3 Jan 2023 · 1 repository · arXiv:2301.01146
• TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models
  3 Jan 2023 · 2 repositories · arXiv:2301.01296
  Syntology official (archive's flag): 2 ran · 8 ran (of which 5 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 11 pointer-only (licence)
• Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
  2 Jan 2023 · 2 repositories · arXiv:2301.00805
• MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understanding
  2 Jan 2023 · 2 repositories · arXiv:2301.00876
• Multi-Stage Spatio-Temporal Aggregation Transformer for Video Person Re-identification
  2 Jan 2023 · 0 repositories · arXiv:2301.00531
• Muse: Text-To-Image Generation via Masked Generative Transformers
  2 Jan 2023 · 5 repositories · arXiv:2301.00704
  Syntology 19 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 5 violated, 1 with no contract checked; 11 where Syntology's instrument failed) · 2 unverified (of 21 harvested samples) · 11 pointer-only (licence)
• Transformer Based Geocoding
  2 Jan 2023 · 0 repositories · arXiv:2301.01170
• Understanding Political Polarisation using Language Models: A dataset and method
  2 Jan 2023 · 0 repositories · arXiv:2301.00891
• 3DPPE: 3D Point Positional Encoding for Transformer-based Multi-Camera 3D Object Detection
  1 Jan 2023 · 1 repository
• A Large-Scale Robustness Analysis of Video Action Recognition Models
  1 Jan 2023 · 0 repositories
• A Simple Vision Transformer for Weakly Semi-supervised 3D Object Detection
  1 Jan 2023 · 0 repositories
• Adaptive and Background-Aware Vision Transformer for Real-Time UAV Tracking
  1 Jan 2023 · 1 repository
• Adversarial Normalization: I Can Visualize Everything (ICE)
  1 Jan 2023 · 1 repository
• AttentionShift: Iteratively Estimated Part-Based Attention Map for Pointly Supervised Instance Segmentation
  1 Jan 2023 · 0 repositories
• AUNet: Learning Relations Between Action Units for Face Forgery Detection
  1 Jan 2023 · 0 repositories
• Automated Knowledge Distillation via Monte Carlo Tree Search
  1 Jan 2023 · 0 repositories
• Bit-Shrinking: Limiting Instantaneous Sharpness for Improving Post-Training Quantization
  1 Jan 2023 · 0 repositories
• Boosting Whole Slide Image Classification from the Perspectives of Distribution, Correlation and Magnification
  1 Jan 2023 · 0 repositories
• Building Vision Transformers with Hierarchy Aware Feature Aggregation
  1 Jan 2023 · 0 repositories
• BUS: Efficient and Effective Vision-Language Pre-Training with Bottom-Up Patch Summarization.
  1 Jan 2023 · 0 repositories
• Chasing Clouds: Differentiable Volumetric Rasterisation of Point Clouds as a Highly Efficient and Accurate Loss for Large-Scale Deformable 3D Registration
  1 Jan 2023 · 1 repository
• CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval
  1 Jan 2023 · 0 repositories