Browse State-of-the-Art › Unsupervised Pre-training › Papers, page 2

Unsupervised Pre-training

Papers archive 2025-07-28

archive papers tagged: 265 · with a code link: 126 · where Syntology ran a sample: 43 (38 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (43 of 265 tagged: 38 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument)

Page 2 of 3: papers 101 to 200 of 265, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. Abstracts are on each paper's page.

• Unsupervised Pre-training for Person Re-identification
  7 Dec 2020 1 repository listed
• MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization Problem
  9 Nov 2020 1 repository listed
• Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
  28 Oct 2020 1 repository listed
• Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping
  26 Oct 2020 1 repository listed
• Unsupervised Vision-and-Language Pre-training Without Parallel Images and Captions
  24 Oct 2020 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
• Self-training Improves Pre-training for Natural Language Understanding
  5 Oct 2020 1 repository listed
• m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural Networks
  23 Aug 2020 1 repository listed
• Functional Regularization for Representation Learning: A Unified Theoretical Perspective
  6 Aug 2020 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 6 pointer-only (licence)
• A Further Study of Unsupervised Pre-training for Transformer Based Speech Recognition
  20 May 2020 1 repository listed
• What Makes for Good Views for Contrastive Learning?
  20 May 2020 1 repository listed
• TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task
  30 Apr 2020 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
• SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discovery
  12 Nov 2019 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
• MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language Models
  5 Nov 2019 1 repository listed
• Pre-train and Learn: Preserve Global Information for Graph Neural Networks
  27 Oct 2019 1 repository listed
• Improving Transformer-based Speech Recognition Using Unsupervised Pre-training
  22 Oct 2019 1 repository listed
• Bridging the domain gap in cross-lingual document classification
  16 Sep 2019 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
• Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data
  1 Aug 2019 1 repository listed
• Tuning Multilingual Transformers for Language-Specific Named Entity Recognition
  1 Aug 2019 1 repository listed
• Improving Relation Extraction by Pre-trained Language Representations
  7 Jun 2019 1 repository listed
• Tuning Multilingual Transformers for Named Entity Recognition on Slavic Languages
  30 Jan 2019 1 repository listed
• Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents
  13 Nov 2018 1 repository listed
• Advancing PICO Element Detection in Biomedical Text via Deep Neural Networks
  30 Oct 2018 1 repository listed
• RMDL: Random Multimodel Deep Learning for Classification
  3 May 2018 1 repository listed
• Learning Deep Representations Using Convolutional Auto-encoders with Symmetric Skip Connections
  28 Nov 2016 1 repository listed
• Post Training in Deep Learning with Last Kernel
  14 Nov 2016 1 repository listed
• Knowledge Matters: Importance of Prior Information for Optimization
  17 Jan 2013 1 repository listed
• Foundation Model for Wireless Technology Recognition Using IQ Timeseries
  26 May 2025 0 repositories listed
• Is MixIT Really Unsuitable for Correlated Sources? Exploring MixIT for Unsupervised Pre-training in Music Source Separation
  12 May 2025 0 repositories listed
• The Efficiency of Pre-training with Objective Masking in Pseudo Labeling for Semi-Supervised Text Classification
  10 May 2025 0 repositories listed
• Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning
  8 May 2025 0 repositories listed Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 10 pointer-only (licence)
• Risk Assessment Framework for Code LLMs via Leveraging Internal States
  20 Apr 2025 0 repositories listed
• Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation
  8 Mar 2025 0 repositories listed
• Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models
  24 Feb 2025 0 repositories listed
• Incomplete Multi-View Multi-label Learning via Disentangled Representation and Label Semantic Embedding
  1 Jan 2025 0 repositories listed
• Targeted Forgetting of Image Subgroups in CLIP Models
  1 Jan 2025 0 repositories listed
• HindiLLM: Large Language Model for Hindi
  29 Dec 2024 0 repositories listed
• Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data
  5 Dec 2024 0 repositories listed
• CLAP: Unsupervised 3D Representation Learning for Fusion 3D Perception via Curvature Sampling and Prototype Learning
  4 Dec 2024 0 repositories listed
• Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting
  27 Nov 2024 0 repositories listed
• Take Package as Language: Anomaly Detection Using Transformer
  15 Nov 2024 0 repositories listed
• Range-aware Positional Encoding via High-order Pretraining: Theory and Practice
  27 Sep 2024 0 repositories listed
• GFlowNet Pretraining with Inexpensive Rewards
  15 Sep 2024 0 repositories listed
• TraIL-Det: Transformation-Invariant Local Feature Networks for 3D LiDAR Object Detection with Unsupervised Pre-Training
  25 Aug 2024 0 repositories listed
• Large Language Model Enabled Semantic Communication Systems
  19 Jul 2024 0 repositories listed
• Learning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck
  29 Jun 2024 0 repositories listed
• ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts
  16 Jun 2024 0 repositories listed
• An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  9 Jun 2024 0 repositories listed
• DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction
  27 Apr 2024 0 repositories listed
• Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition
  28 Mar 2024 0 repositories listed
• BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin
  12 Mar 2024 0 repositories listed
• On the Generalization Ability of Unsupervised Pretraining
  11 Mar 2024 0 repositories listed
• Attention-Guided Masked Autoencoders For Learning Image Representations
  23 Feb 2024 0 repositories listed
• CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion
  22 Feb 2024 0 repositories listed
• CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion Recognition
  10 Feb 2024 0 repositories listed
• MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning
  3 Feb 2024 0 repositories listed
• Unsupervised Pre-Training for 3D Leaf Instance Segmentation
  16 Jan 2024 0 repositories listed
• FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs
  12 Dec 2023 0 repositories listed
• Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis
  17 Oct 2023 0 repositories listed
• Semi-Supervised End-To-End Contrastive Learning For Time Series Classification
  13 Oct 2023 0 repositories listed
• Automated clinical coding using off-the-shelf large language models
  10 Oct 2023 0 repositories listed
• CUPre: Cross-domain Unsupervised Pre-training for Few-Shot Cell Segmentation
  6 Oct 2023 0 repositories listed
• Classifying Whole Slide Images: What Matters?
  5 Oct 2023 0 repositories listed
• Pre-Training and Fine-Tuning Generative Flow Networks
  5 Oct 2023 0 repositories listed
• Differentially Private Optimization for Non-Decomposable Objective Functions
  4 Oct 2023 0 repositories listed
• A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting)
  30 Sep 2023 0 repositories listed
• Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project
  26 Sep 2023 0 repositories listed
• Examining the Effect of Pre-training on Time Series Classification
  11 Sep 2023 0 repositories listed
• Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training
  1 Sep 2023 0 repositories listed
• Masked Feature Modelling: Feature Masking for the Unsupervised Pre-training of a Graph Attention Network Block for Bottom-up Video Event Recognition
  24 Aug 2023 0 repositories listed
• Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning
  8 Aug 2023 0 repositories listed
• Towards General Text Embeddings with Multi-stage Contrastive Learning
  7 Aug 2023 0 repositories listed
• Disentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction
  17 Jul 2023 0 repositories listed
• ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning
  10 Jun 2023 0 repositories listed
• Incorporating Unlabelled Data into Bayesian Neural Networks
  4 Apr 2023 0 repositories listed
• Research on CPI Prediction Based on Natural Language Processing
  10 Mar 2023 0 repositories listed
• Device Tuning for Multi-Task Large Model
  21 Feb 2023 0 repositories listed
• A Benchmark of Nested Named Entity Recognition Approaches in Historical Structured Documents
  20 Feb 2023 0 repositories listed
• Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Prompt
  2 Feb 2023 0 repositories listed
• Self-FuseNet: Data Free Unsupervised Remote Sensing Image Super-Resolution
  23 Jan 2023 0 repositories listed
• Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project
  1 Jan 2023 0 repositories listed
• ACROBAT -- a multi-stain breast cancer histological whole-slide-image data set from routine diagnostics for computational pathology
  24 Nov 2022 0 repositories listed
• EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Model
  2 Oct 2022 0 repositories listed
• Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning
  23 Aug 2022 0 repositories listed
• Spiral Contrastive Learning: An Efficient 3D Representation Learning Method for Unannotated CT Lesions
  23 Aug 2022 0 repositories listed
• Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis
  16 Jul 2022 0 repositories listed
• Unsupervised Instance Discriminative Learning for Depression Detection from Speech Signals
  27 Jun 2022 0 repositories listed
• Deep Features for CBIR with Scarce Data using Hebbian Learning
  18 May 2022 0 repositories listed
• Boundary-aware Information Maximization for Self-supervised Medical Image Segmentation
  4 Feb 2022 0 repositories listed
• 3D Intracranial Aneurysm Classification and Segmentation via Unsupervised Dual-branch Learning
  6 Jan 2022 0 repositories listed
• Unleashing Potential of Unsupervised Pre-Training With Intra-Identity Regularization for Person Re-Identification
  1 Jan 2022 0 repositories listed
• 4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding
  6 Dec 2021 0 repositories listed
• Improving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment
  1 Nov 2021 0 repositories listed
• SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training
  20 Oct 2021 0 repositories listed
• Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference
  8 Sep 2021 0 repositories listed
• Triplet Contrastive Learning for Brain Tumor Classification
  8 Aug 2021 0 repositories listed
• Residual Contrastive Learning for Image Reconstruction: Learning Transferable Representations from Noisy Images
  18 Jun 2021 0 repositories listed
• Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attention
  17 Jun 2021 0 repositories listed
• Automatic Sexism Detection with Multilingual Transformer Models
  9 Jun 2021 0 repositories listed
• Audio Transformers
  1 May 2021 0 repositories listed
• SYNFIX: Automatically Fixing Syntax Errors using Compiler Diagnostics
  29 Apr 2021 0 repositories listed

Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page has not changed since 2026-09-28, the first build that kept a record date for it; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.