Methods › General › Miscellaneous Components › Positional Encoding Generator
Positional Encoding Generator
Introduced by Xiangxiang Chu et al. in Conditional Positional Encodings for Vision Transformers
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Positional Encoding Generator, or PEG, is a module used in the Conditional Position Encoding position embeddings. It dynamically produce the positional encodings conditioned on the local neighborhood of an input token. To condition on the local neighbors, we first reshape the flattened input sequence X ∈ℝ^(B ×N ×C) of DeiT back to X^' ∈ℝ^(B ×H ×W ×C) in the 2 -D image space. Then, a function (denoted by ℱ in the Figure) is repeatedly applied to the local patch in X^' to produce the conditional positional encodings E^(B ×H ×W ×C) . PEG can be efficiently implemented with a 2-D convolution with kernel k(k ≥3) and (k-1)/2 zero paddings. Note that the zero paddings here are important to make the model be aware of the absolute positions, and ℱ can be of various forms such as separable convolutions and many others.
Papers archive 2025-07-28
8 shown of 8, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
WriteViT: Handwritten Text Generation with Vision Transformer 19 May 2025 · 1 repository · arXiv:2505.13235
-
CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding 10 Dec 2024 · 1 repository · arXiv:2412.07236Syntology ran 2 of 5 samples · 3 unverified
-
Serialized Point Mamba: A Serialized Point Cloud Mamba Segmentation Model 17 Jul 2024 · 0 repositories · arXiv:2407.12319
-
CSTA: CNN-based Spatiotemporal Attention for Video Summarization 20 May 2024 · 1 repository · arXiv:2405.11905Syntology ran 7 of 8 samples · 1 unverified
-
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis 26 Mar 2024 · 2 repositories · arXiv:2403.18063Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
-
V4d: voxel for 4d novel view synthesis 28 May 2022 · 1 repository · arXiv:2205.14332
-
Twins: Revisiting the Design of Spatial Attention in Vision Transformers 28 Apr 2021 · 9 repositories · arXiv:2104.13840Syntology ran 0 of 2 samples · 2 unverified · 2 pointer-only (licence)
-
Conditional Positional Encodings for Vision Transformers 22 Feb 2021 · 2 repositories · arXiv:2102.10882
Tasks archive 2025-07-28
20 shown of 29 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections