Inductive Bias

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 716 papers with code (1,529 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Prototypical Networks for Few-shot Learning
  15 Mar 2017 43 repositories listed Syntology ran 49 of 64 samples · 15 unverified · 18 pointer-only (licence)
  We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class.
• Relational inductive biases, deep learning, and graph networks
  4 Jun 2018 31 repositories listed Syntology ran 13 of 51 samples · 38 unverified · 15 pointer-only (licence)
  As a companion to this paper, we have released an open-source software library for building graph networks, with demonstrations of how to use them in practice.
• How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
  18 Jun 2021 16 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  Vision Transformers (ViT) have been shown to attain highly competitive performance for a wide range of vision applications, such as image classification, object detection and semantic image segmentation.
• Video Swin Transformer
  24 Jun 2021 15 repositories listed Syntology ran 7 of 32 samples · 25 unverified
  The vision community is witnessing a modeling shift from CNNs to Transformers, where pure Transformer architectures have attained top accuracy on the major video recognition benchmarks.
• CoAtNet: Marrying Convolution and Attention for All Data Sizes
  9 Jun 2021 14 repositories listed Syntology ran 2 of 5 samples · 3 unverified · 1 pointer-only (licence)
  Transformers have attracted increasing interests in computer vision, but they still fall behind state-of-the-art convolutional networks.
• Deep Image Prior
  29 Nov 2017 14 repositories listed Syntology ran 5 of 6 samples · 1 unverified · 6 pointer-only (licence)
  In this paper, we show that, on the contrary, the structure of a generator network is sufficient to capture a great deal of low-level image statistics prior to any learning.
• Taming Transformers for High-Resolution Image Synthesis
  17 Dec 2020 13 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 4 pointer-only (licence)
  We demonstrate how combining the effectiveness of the inductive bias of CNNs with the expressivity of transformers enables them to model and thereby synthesize high-resolution images.
• Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
  27 Aug 2021 10 repositories listed Syntology ran 13 of 16 samples · 3 unverified · 5 pointer-only (licence)
  Since the introduction of the transformer model by Vaswani et al.
• Inductive Relation Prediction by Subgraph Reasoning
  16 Nov 2019 10 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  The dominant paradigm for relation prediction in knowledge graphs involves learning and operating on latent representations (i.
• ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases
  19 Mar 2021 9 repositories listed
  We initialise the GPSA layers to mimic the locality of convolutional layers, then give each attention head the freedom to escape locality by adjusting a gating parameter regulating the attention paid to position versus…
• Global Context Vision Transformers
  20 Jun 2022 8 repositories listed Syntology ran 17 of 36 samples · 19 unverified · 15 pointer-only (licence)
  Pre-trained GC ViT backbones in downstream tasks of object detection, instance segmentation, and semantic segmentation using MS COCO and ADE20K datasets outperform prior work consistently.
• ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond
  21 Feb 2022 8 repositories listed Syntology ran 15 of 25 samples · 10 unverified · 2 pointer-only (licence)
  Vision transformers have shown great potential in various computer vision tasks owing to their strong capability to model long-range dependency using the self-attention mechanism.
• Universal Transformers
  10 Jul 2018 8 repositories listed Syntology ran 14 of 25 samples · 11 unverified · 24 pointer-only (licence)
  Feed-forward and convolutional architectures have recently been shown to achieve superior results on some sequence modeling tasks such as machine translation, with the added advantage that they concurrently process all…
• Mega: Moving Average Equipped Gated Attention
  21 Sep 2022 7 repositories listed Syntology ran 12 of 13 samples · 1 unverified · 8 pointer-only (licence)
  The design choices in the Transformer attention mechanism, including weak inductive bias and quadratic computational complexity, have limited its application for modeling long sequences.
• Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks
  22 Oct 2018 7 repositories listed Syntology ran 3 of 12 samples · 9 unverified
  When a larger constituent ends, all of the smaller constituents that are nested within it must also be closed.
• Multi-Task Learning as Multi-Objective Optimization
  10 Oct 2018 7 repositories listed Syntology ran 2 of 19 samples · 17 unverified
  These algorithms are not directly applicable to large-scale learning problems since they scale poorly with the dimensionality of the gradients and the number of tasks.
• Crystal Diffusion Variational Autoencoder for Periodic Material Generation
  12 Oct 2021 6 repositories listed Syntology ran 5 of 36 samples · 31 unverified
  Generating the periodic structure of stable materials is a long-standing challenge for the material design community.
• CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation
  11 Mar 2021 6 repositories listed
  Pipelined NLP systems have largely been superseded by end-to-end neural modeling, yet nearly all commonly-used models still require an explicit tokenization step.
• Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems
  11 May 2019 6 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  Here we propose Knowledge-aware Graph Neural Networks with Label Smoothness regularization (KGNN-LS) to provide better recommendations.
• BigVGAN: A Universal Neural Vocoder with Large-Scale Training
  9 Jun 2022 5 repositories listed Syntology ran 8 of 17 samples · 9 unverified · 1 pointer-only (licence)
  Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous…
• Sequencer: Deep LSTM for Image Classification
  4 May 2022 5 repositories listed Syntology ran 4 of 9 samples · 5 unverified
  Here we propose Sequencer, a novel and competitive architecture alternative to ViT that provides a new perspective on these issues.
• Vision Transformer for Small-Size Datasets
  27 Dec 2021 5 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 1 pointer-only (licence)
  However, the high performance of the ViT results from pre-training using a large-size dataset such as JFT-300M, and its dependence on a large dataset is interpreted as due to low locality inductive bias.
• Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis
  1 Jun 2023 4 repositories listed Syntology ran 5 of 16 samples · 11 unverified
  Recent advancements in neural vocoding are predominantly driven by Generative Adversarial Networks (GANs) operating in the time-domain.
• Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach
  23 Oct 2022 4 repositories listed Syntology ran 0 of 9 samples · 9 unverified
  Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and…
• Brain-inspired Multilayer Perceptron with Spiking Neurons
  28 Mar 2022 4 repositories listed
  However, due to the simplicity of their structures, the performance highly depends on the local features communication machenism.
• Container: Context Aggregation Network
  2 Jun 2021 4 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  Convolutional neural networks (CNNs) are ubiquitous in computer vision, with a myriad of effective and efficient variations.
• Data-Free Knowledge Distillation for Heterogeneous Federated Learning
  20 May 2021 4 repositories listed
  Federated Learning (FL) is a decentralized machine-learning paradigm, in which a global server iteratively averages the model parameters of local users without accessing their data.
• On the Transfer of Inductive Bias from Simulation to the Real World: a New Disentanglement Dataset
  7 Jun 2019 4 repositories listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Learning meaningful and compact representations with disentangled semantic aspects is considered to be of key importance in representation learning.
• A Hierarchical Probabilistic U-Net for Modeling Multi-Scale Ambiguities
  30 May 2019 4 repositories listed Syntology ran 2 of 3 samples · 1 unverified
  Medical imaging only indirectly measures the molecular identity of the tissue within each voxel, which often produces only ambiguous image evidence for target measures of interest, like semantic segmentation.
• 3D Packing for Self-Supervised Monocular Depth Estimation
  6 May 2019 4 repositories listed
  Although cameras are ubiquitous, robotic platforms typically rely on active sensors like LiDAR for direct 3D perception.

Syntology lines on 25 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.