Methods › Natural Language Processing › Autoencoding Transformers › BERT › Papers where code ran, page 3

BERT

Papers archive 2025-07-28

archive papers tagged: 6,938 · with a code link: 2,862 · where Syntology ran a sample: 640 (520 with a run with no instrument failure, 120 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (640 of 6,938 tagged: 520 with a run with no instrument failure, 120 where every run was a failure of Syntology's instrument)

Syntology We ran code from the paper's repository; we did not isolate this method inside it.

Page 3 of 7: papers 201 to 300 of the 640 tagged papers where Syntology ran at least one harvested sample (520 with a run with no instrument failure, 120 where every run was a failure of Syntology's instrument), newest first by the archive's date (ties by arXiv id). This is a filter on Syntology's record ordered by date only, not a ranking; a run is not a correctness claim. A paper missing from this list is not a recorded non-run: it may have no arXiv id, no harvested code, or only samples that have not run yet.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
  29 Aug 2023 · 1 repository · arXiv:2308.15122
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
• SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation
  21 Aug 2023 · 1 repository · arXiv:2308.10873
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 17 pointer-only (licence)
• How Good Are LLMs at Out-of-Distribution Detection?
  20 Aug 2023 · 1 repository · arXiv:2308.10261
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Ternary Singular Value Decomposition as a Better Parameterized Form in Linear Mapping
  15 Aug 2023 · 1 repository · arXiv:2308.07641
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• DaMSTF: Domain Adversarial Learning Enhanced Meta Self-Training for Domain Adaptation
  5 Aug 2023 · 0 repositories · arXiv:2308.02753
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)
• New Interaction Paradigm for Complex EDA Software Leveraging GPT
  27 Jul 2023 · 1 repository · arXiv:2307.14740
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
  12 Jul 2023 · 1 repository · arXiv:2307.06440
  Syntology official (archive's flag): 9 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 3 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 13 pointer-only (licence)
• CAME: Confidence-guided Adaptive Memory Efficient Optimization
  5 Jul 2023 · 2 repositories · arXiv:2307.02047
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples) · 1 pointer-only (licence)
• KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation
  4 Jul 2023 · 0 repositories · arXiv:2307.01878
  Syntology 6 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
• Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models
  18 Jun 2023 · 1 repository · arXiv:2306.10460
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• Linear Classifier: An Often-Forgotten Baseline for Text Classification
  12 Jun 2023 · 1 repository · arXiv:2306.07111
  Syntology official: no sample here; runs from other or unrecorded repositories · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples)
• Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Tasks
  8 Jun 2023 · 1 repository · arXiv:2306.05550
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• LEACE: Perfect linear concept erasure in closed form
  6 Jun 2023 · 2 repositories · arXiv:2306.03819
  Syntology official (archive's flag): 3 ran · 12 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples)
• Training-free Neural Architecture Search for RNNs and Transformers
  1 Jun 2023 · 1 repository · arXiv:2306.00288
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• Make Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  1 Jun 2023 · 1 repository · arXiv:2306.00477
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• XPhoneBERT: A Pre-trained Multilingual Model for Phoneme Representations for Text-to-Speech
  31 May 2023 · 2 repositories · arXiv:2305.19709
  Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 2 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples) · 10 pointer-only (licence)
• From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework
  29 May 2023 · 1 repository · arXiv:2305.18503
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• A Causal View of Entity Bias in (Large) Language Models
  24 May 2023 · 1 repository · arXiv:2305.14695
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives
  24 May 2023 · 1 repository · arXiv:2305.15032
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 11 harvested samples)
• All Roads Lead to Rome? Exploring the Invariance of Transformers' Representations
  23 May 2023 · 1 repository · arXiv:2305.14555
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Explaining black box text modules in natural language with language models
  17 May 2023 · 2 repositories · arXiv:2305.09863
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression
  17 May 2023 · 1 repository · arXiv:2305.10010
  Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modeling
  14 May 2023 · 1 repository · arXiv:2305.08264
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• Scaling Transformer to 1M tokens and beyond with RMT
  19 Apr 2023 · 3 repositories · arXiv:2304.11062
  Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling
  18 Apr 2023 · 1 repository · arXiv:2304.09145
  Syntology official (archive's flag): 5 ran · 5 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
• Micron-BERT: BERT-based Facial Micro-Expression Recognition
  6 Apr 2023 · 1 repository · arXiv:2304.03195
  Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Improved Visual Fine-tuning with Natural Language Supervision
  4 Apr 2023 · 1 repository · arXiv:2304.01489
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Trained on 100 million words and still in shape: BERT meets British National Corpus
  17 Mar 2023 · 2 repositories · arXiv:2303.09859
  Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 7 harvested samples) · 7 pointer-only (licence)
• SmartBERT: A Promotion of Dynamic Early Exiting Mechanism for Accelerating BERT Inference
  16 Mar 2023 · 0 repositories · arXiv:2303.09266
  Syntology 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 4 harvested samples)
• Jump to Conclusions: Short-Cutting Transformers With Linear Transformations
  16 Mar 2023 · 2 repositories · arXiv:2303.09435
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• TrojText: Test-time Invisible Textual Trojan Insertion
  3 Mar 2023 · 1 repository · arXiv:2303.02242
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
• Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers
  2 Mar 2023 · 1 repository · arXiv:2303.01610
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers
  23 Feb 2023 · 1 repository · arXiv:2302.11812
  Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Marich: A Query-efficient Distributionally Equivalent Model Extraction Attack using Public Data
  16 Feb 2023 · 1 repository · arXiv:2302.08466
  Syntology official (archive's flag): 5 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)
• Resilient Binary Neural Network
  2 Feb 2023 · 1 repository · arXiv:2302.00956
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
• Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions
  20 Jan 2023 · 2 repositories · arXiv:2301.08810
  Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
• Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
  9 Jan 2023 · 2 repositories · arXiv:2301.03580
  Syntology official (archive's flag): 9 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 2 pointer-only (licence)
• Cramming: Training a Language Model on a Single GPU in One Day
  28 Dec 2022 · 1 repository · arXiv:2212.14034
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Pretraining Without Attention
  20 Dec 2022 · 1 repository · arXiv:2212.10544
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Bort: Towards Explainable Neural Networks with Bounded Orthogonal Constraint
  18 Dec 2022 · 1 repository · arXiv:2212.09062
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks
  16 Dec 2022 · 1 repository · arXiv:2212.08322
  Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking
  15 Dec 2022 · 1 repository · arXiv:2212.07617
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
  14 Dec 2022 · 5 repositories · arXiv:2212.07525
  Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 2 pointer-only (licence)
• LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training
  6 Dec 2022 · 1 repository · arXiv:2212.02691
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
• ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT
  30 Nov 2022 · 1 repository · arXiv:2211.17201
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
  28 Nov 2022 · 1 repository · arXiv:2211.15029
  Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 2 pointer-only (licence)
• An Analysis of Social Biases Present in BERT Variants Across Multiple Languages
  25 Nov 2022 · 1 repository · arXiv:2211.14402
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Collateral facilitation in humans and language models
  9 Nov 2022 · 1 repository · arXiv:2211.05198
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Fine-Tuning Language Models via Epistemic Neural Networks
  3 Nov 2022 · 1 repository · arXiv:2211.01568
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning
  27 Oct 2022 · 1 repository · arXiv:2210.15212
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
• Amos: An Adam-style Optimizer with Adaptive Weight Decay towards Model-Oriented Scale
  21 Oct 2022 · 1 repository · arXiv:2210.11693
  Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 18 harvested samples)
• Tempo: Accelerating Transformer-Based Model Training through Memory Footprint Reduction
  19 Oct 2022 · 1 repository · arXiv:2210.10246
  Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler
  18 Oct 2022 · 1 repository · arXiv:2210.10105
  Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Foundation Transformers
  12 Oct 2022 · 4 repositories · arXiv:2210.06423
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
• A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models
  11 Oct 2022 · 1 repository · arXiv:2210.05211
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Vote'n'Rank: Revision of Benchmarking with Social Choice Theory
  11 Oct 2022 · 1 repository · arXiv:2210.05769
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified (of 17 harvested samples)
• Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models
  27 Sep 2022 · 1 repository · arXiv:2209.13325
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling
  21 Sep 2022 · 2 repositories · arXiv:2209.10335
  Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
• Transformers with Learnable Activation Functions
  30 Aug 2022 · 2 repositories · arXiv:2208.14111
  Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)
• Addressing Token Uniformity in Transformers via Singular Value Transformation
  24 Aug 2022 · 1 repository · arXiv:2208.11790
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• VAuLT: Augmenting the Vision-and-Language Transformer for Sentiment Classification on Social Media
  18 Aug 2022 · 1 repository · arXiv:2208.09021
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
• Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  13 Aug 2022 · 9 repositories · arXiv:2208.06677
  Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• E2EG: End-to-End Node Classification Using Graph Topology and Text-based Node Attributes
  9 Aug 2022 · 1 repository · arXiv:2208.04609
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 4 pointer-only (licence)
• CrAM: A Compression-Aware Minimizer
  28 Jul 2022 · 1 repository · arXiv:2207.14200
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
• ELECTRA is a Zero-Shot Learner, Too
  17 Jul 2022 · 1 repository · arXiv:2207.08141
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• Language Modelling with Pixels
  14 Jul 2022 · 1 repository · arXiv:2207.06991
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Bootstrapped Masked Autoencoders for Vision BERT Pretraining
  14 Jul 2022 · 1 repository · arXiv:2207.07116
  Syntology official (archive's flag): 6 ran · 6 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 6 samples that ran constructed an object rather than computing a result (of 7 harvested samples) · 7 pointer-only (licence)
• Re2G: Retrieve, Rerank, Generate
  13 Jul 2022 · 1 repository · arXiv:2207.06300
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
• AnoShift: A Distribution Shift Benchmark for Unsupervised Anomaly Detection
  30 Jun 2022 · 1 repository · arXiv:2206.15476
  Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples)
• Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data
  20 Jun 2022 · 1 repository · arXiv:2206.09591
  Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 6 harvested samples) · 6 pointer-only (licence)
• SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features
  14 Jun 2022 · 1 repository · arXiv:2206.07023
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples)
• Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training
  13 Jun 2022 · 1 repository · arXiv:2206.06501
  Syntology 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)
• Multimodal Masked Autoencoders Learn Transferable Representations
  27 May 2022 · 3 repositories · arXiv:2205.14204
  Syntology official (archive's flag): 3 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples)
• RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning
  25 May 2022 · 1 repository · arXiv:2205.12598
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)
• Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling
  25 May 2022 · 1 repository · arXiv:2205.12986
  Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
• BiT: Robustly Binarized Multi-distilled Transformer
  25 May 2022 · 3 repositories · arXiv:2205.13016
  Syntology official (archive's flag): 2 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Parameter-Efficient Sparsity for Large Language Models Fine-Tuning
  23 May 2022 · 2 repositories · arXiv:2205.11005
  Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
• Prompt Tuning for Discriminative Pre-trained Language Models
  23 May 2022 · 1 repository · arXiv:2205.11166
  Syntology official (archive's flag): 7 ran · 7 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 12 harvested samples)
• Outliers Dimensions that Disrupt Transformers Are Driven by Frequency
  23 May 2022 · 1 repository · arXiv:2205.11380
  Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified (of 16 harvested samples)
• On the Paradox of Learning to Reason from Data
  23 May 2022 · 1 repository · arXiv:2205.11502
  Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
• GraphMAE: Self-Supervised Masked Graph Autoencoders
  22 May 2022 · 3 repositories · arXiv:2205.10803
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• A Study of the Attention Abnormality in Trojaned BERTs
  13 May 2022 · 1 repository · arXiv:2205.08305
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• SemAttack: Natural Textual Attacks via Different Semantic Spaces
  3 May 2022 · 1 repository · arXiv:2205.01287
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics
  21 Apr 2022 · 1 repository · arXiv:2204.09874
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification
  20 Apr 2022 · 1 repository · arXiv:2204.09371
  Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
• Probing for Constituency Structure in Neural Language Models
  13 Apr 2022 · 1 repository · arXiv:2204.06201
  Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Modeling Multi-Granularity Hierarchical Features for Relation Extraction
  9 Apr 2022 · 1 repository · arXiv:2204.04437
  Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  7 Apr 2022 · 1 repository · arXiv:2204.03243
  Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 2 pointer-only (licence)
• PALBERT: Teaching ALBERT to Ponder
  7 Apr 2022 · 1 repository · arXiv:2204.03276
  Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)
• Monarch: Expressive Structured Matrices for Efficient and Accurate Training
  1 Apr 2022 · 2 repositories · arXiv:2204.00595
  Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 1 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 15 harvested samples)
• mc-BEiT: Multi-choice Discretization for Image BERT Pre-training
  29 Mar 2022 · 1 repository · arXiv:2203.15371
  Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 5 harvested samples) · 5 pointer-only (licence)
• LinkBERT: Pretraining Language Models with Document Links
  29 Mar 2022 · 1 repository · arXiv:2203.15827
  Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified (of 14 harvested samples)
• A Fast Post-Training Pruning Framework for Transformers
  29 Mar 2022 · 2 repositories · arXiv:2204.09656
  Syntology official (archive's flag): 1 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• StruBERT: Structure-aware BERT for Table Search and Matching
  27 Mar 2022 · 1 repository · arXiv:2203.14278
  Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples)
• Input-specific Attention Subnetworks for Adversarial Detection
  23 Mar 2022 · 0 repositories · arXiv:2203.12298
  Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretation
  23 Mar 2022 · 1 repository · arXiv:2203.12709
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis
  22 Mar 2022 · 1 repository · arXiv:2203.11702
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• Perturbations in the Wild: Leveraging Human-Written Text Perturbations for Realistic Adversarial Attack and Defense
  19 Mar 2022 · 1 repository · arXiv:2203.10346
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• KinyaBERT: a Morphology-aware Kinyarwanda Language Model
  16 Mar 2022 · 1 repository · arXiv:2203.08459
  Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples)
• Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost
  15 Mar 2022 · 1 repository · arXiv:2203.07860
  Syntology official (archive's flag): 2 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)