Browse State-of-the-Art › Unsupervised Pre-training › Papers, page 3

Unsupervised Pre-training

Papers archive 2025-07-28

archive papers tagged: 265 · with a code link: 126 · where Syntology ran a sample: 43 (38 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (43 of 265 tagged: 38 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument)

Page 3 of 3: papers 201 to 265 of 265, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Representation Learning for Weakly Supervised Relation Extraction
  10 Apr 2021 0 repositories listed
• On Architectures and Training for Raw Waveform Feature Extraction in ASR
  9 Apr 2021 0 repositories listed
• Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models
  1 Apr 2021 0 repositories listed
• Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors
  8 Mar 2021 0 repositories listed
• A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning
  1 Mar 2021 0 repositories listed
• Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning
  24 Feb 2021 0 repositories listed
• Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR
  12 Feb 2021 0 repositories listed
• AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21
  11 Jan 2021 0 repositories listed
• R-LAtte: Attention Module for Visual Control via Reinforcement Learning
  1 Jan 2021 0 repositories listed
• Unsupervised Active Pre-Training for Reinforcement Learning
  1 Jan 2021 0 repositories listed
• Machine Translation Pre-training for Data-to-Text Generation - A Case Study in Czech
  1 Dec 2020 0 repositories listed
• Bi-tuning of Pre-trained Representations
  12 Nov 2020 0 repositories listed
• Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning
  3 Nov 2020 0 repositories listed
• Pre-training Graph Transformer with Multimodal Side Information for Recommendation
  23 Oct 2020 0 repositories listed
• GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method
  23 Oct 2020 0 repositories listed
• Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring
  13 Oct 2020 0 repositories listed
• Unsupervised Pre-training for Biomedical Question Answering
  27 Sep 2020 0 repositories listed
• ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model
  8 Sep 2020 0 repositories listed
• Unsupervised Learning For Sequence-to-sequence Text-to-speech For Low-resource Languages
  11 Aug 2020 0 repositories listed
• Weakly Supervised Construction of ASR Systems with Massive Video Data
  4 Aug 2020 0 repositories listed
• Unsupervised Deep Representation Learning and Few-Shot Classification of PolSAR Images
  27 Jun 2020 0 repositories listed
• Measles Rash Identification Using Residual Deep Convolutional Neural Network
  18 May 2020 0 repositories listed
• Lottery Hypothesis based Unsupervised Pre-training for Model Compression in Federated Learning
  21 Apr 2020 0 repositories listed
• Pre-training Text Representations as Meta Learning
  12 Apr 2020 0 repositories listed
• Author2Vec: A Framework for Generating User Embedding
  17 Mar 2020 0 repositories listed
• Transfer Learning for Context-Aware Spoken Language Understanding
  3 Mar 2020 0 repositories listed
• Unsupervised Pre-trained, Texture Aware And Lightweight Model for Deep Learning-Based Iris Recognition Under Limited Annotated Data
  20 Feb 2020 0 repositories listed
• Synthetic vascular structure generation for unsupervised pre-training in CTA segmentation tasks
  2 Jan 2020 0 repositories listed
• Unsupervised Pre-training for Natural Language Generation: A Literature Review
  13 Nov 2019 0 repositories listed
• Combining Unsupervised Pre-training and Annotator Rationales to Improve Low-shot Text Classification
  1 Nov 2019 0 repositories listed
• Empirical Evaluation of Active Learning Techniques for Neural MT
  1 Nov 2019 0 repositories listed
• Extractive NarrativeQA with Heuristic Pre-Training
  1 Nov 2019 0 repositories listed
• Recognizing UMLS Semantic Types with Deep Learning
  1 Nov 2019 0 repositories listed
• Unsupervised pre-training for sequence to sequence speech recognition
  28 Oct 2019 0 repositories listed
• Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models
  3 Oct 2019 0 repositories listed
• SMiRL: Surprise Minimizing RL in Entropic Environments
  25 Sep 2019 0 repositories listed
• Understanding Semantics from Speech Through Pre-training
  24 Sep 2019 0 repositories listed
• Effective training of deep convolutional neural networks for hyperspectral image classification through artificial labeling
  12 Sep 2019 0 repositories listed
• Cross-Domain Training for Goal-Oriented Conversational Agents
  1 Sep 2019 0 repositories listed
• Exploiting Unsupervised Pre-training and Automated Feature Engineering for Low-resource Hate Speech Detection in Polish
  17 Jun 2019 0 repositories listed
• Color Constancy Convolutional Autoencoder
  4 Jun 2019 0 repositories listed
• UHH-LT at SemEval-2019 Task 6: Supervised vs. Unsupervised Transfer Learning for Offensive Language Detection
  1 Jun 2019 0 repositories listed
• Unsupervised pre-training helps to conserve views from input distribution
  30 May 2019 0 repositories listed
• Leveraging Random Label Memorization for Unsupervised Pre-Training
  5 Nov 2018 0 repositories listed
• Temporal Interpolation as an Unsupervised Pretraining Task for Optical Flow Estimation
  21 Sep 2018 0 repositories listed
• Deep Belief Networks Based Feature Generation and Regression for Predicting Wind Power
  31 Jul 2018 0 repositories listed
• Deep Discriminative Model for Video Classification
  22 Jul 2018 0 repositories listed
• DiscrimNet: Semi-Supervised Action Recognition from Videos using Generative Adversarial Networks
  22 Jan 2018 0 repositories listed
• Post-training for Deep Learning
  1 Jan 2018 0 repositories listed
• Co-Morbidity Exploration on Wearables Activity Data Using Unsupervised Pre-training and Multi-Task Learning
  27 Dec 2017 0 repositories listed
• Enhance Visual Recognition under Adverse Conditions via Deep Networks
  20 Dec 2017 0 repositories listed
• Self-Supervised Relative Depth Learning for Urban Scene Understanding
  13 Dec 2017 0 repositories listed
• A Pitfall of Unsupervised Pre-Training
  23 Nov 2017 0 repositories listed
• Discovery of Visual Semantics by Unsupervised and Self-Supervised Representation Learning
  19 Aug 2017 0 repositories listed
• A Pitfall of Unsupervised Pre-Training
  13 Mar 2017 0 repositories listed
• Unsupervised Pre-training With Seq2Seq Reconstruction Loss for Deep Relation Extraction Models
  1 Dec 2016 0 repositories listed
• Unsupervised Learning with Truncated Gaussian Graphical Models
  15 Nov 2016 0 repositories listed
• Adversarial Ladder Networks
  7 Nov 2016 0 repositories listed
• What is the Best Feature Learning Procedure in Hierarchical Recognition Architectures?
  5 Jun 2016 0 repositories listed
• Learning Discriminative Features with Class Encoder
  9 May 2016 0 repositories listed
• Faster learning of deep stacked autoencoders on multi-core systems using synchronized layer-wise pre-training
  9 Mar 2016 0 repositories listed
• Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
  25 Nov 2015 0 repositories listed
• Convergence of gradient based pre-training in Denoising autoencoders
  12 Feb 2015 0 repositories listed
• Learning Non-Linear Reconstruction Models for Image Set Classification
  1 Jun 2014 0 repositories listed
• Temporal Autoencoding Improves Generative Models of Time Series
  12 Sep 2013 0 repositories listed