Methods › Natural Language Processing › Transformers › RoBERTa › Papers, page 8

RoBERTa

Papers archive 2025-07-28

archive papers tagged: 913 · with a code link: 399 · where Syntology ran a sample: 87 (66 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (87 of 913 tagged: 66 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument)

Page 8 of 10: papers 701 to 800 of 913, newest first by the archive's date (ties by slug), in archive order.

Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.

• PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT
  22 Mar 2021 · 2 repositories · arXiv:2103.11933
• Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees
  7 Mar 2021 · 1 repository · arXiv:2103.04350
• NLP-CUET@LT-EDI-EACL2021: Multilingual Code-Mixed Hope Speech Detection using Cross-lingual Representation Learner
  28 Feb 2021 · 1 repository · arXiv:2103.00464
• COVID-19 Tweets Analysis through Transformer Language Models
  27 Feb 2021 · 1 repository · arXiv:2103.00199
• Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations
  25 Feb 2021 · 0 repositories · arXiv:2102.12858
• From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection
  24 Feb 2021 · 0 repositories · arXiv:2102.12162
• Hopeful_Men@LT-EDI-EACL2021: Hope Speech Detection Using Indic Transliteration and Transformers
  24 Feb 2021 · 0 repositories · arXiv:2102.12082
• NLRG at SemEval-2021 Task 5: Toxic Spans Detection Leveraging BERT-based Token Classification and Span Prediction Techniques
  24 Feb 2021 · 1 repository · arXiv:2102.12254
• Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model
  22 Feb 2021 · 0 repositories · arXiv:2102.11114
• Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach
  19 Feb 2021 · 1 repository · arXiv:2102.09943
• Using Transformer based Ensemble Learning to classify Scientific Articles
  19 Feb 2021 · 2 repositories · arXiv:2102.09991
• Analysis Of Contextual and Non-Contextual Word Embedding Models For Hindi NER With Web Application For Data Collection
  18 Feb 2021 · 1 repository
• Training Large-Scale News Recommenders with Pretrained Language Models in the Loop
  18 Feb 2021 · 1 repository · arXiv:2102.09268
• Have Attention Heads in BERT Learned Constituency Grammar?
  16 Feb 2021 · 0 repositories · arXiv:2102.07926
• Improved Customer Transaction Classification using Semi-Supervised Knowledge Distillation
  15 Feb 2021 · 0 repositories · arXiv:2102.07635
• indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages
  14 Feb 2021 · 1 repository · arXiv:2102.07150
• indicnlp@ kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages
  14 Feb 2021 · 1 repository
• Spoiler Alert: Using Natural Language Processing to Detect Spoilers in Book Reviews
  7 Feb 2021 · 1 repository · arXiv:2102.03882
• Bootstrapping Multilingual AMR with Contextual Word Alignments
  3 Feb 2021 · 0 repositories · arXiv:2102.02189
• Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysis
  3 Feb 2021 · 0 repositories · arXiv:2102.02111
• Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection
  14 Jan 2021 · 0 repositories · arXiv:2101.05509
• LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT
  13 Jan 2021 · 1 repository · arXiv:2101.04965
• Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualized Embeddings
  10 Jan 2021 · 1 repository · arXiv:2101.11422
• Applying Transfer Learning for Improving Domain-Specific Search Experience Using Query to Question Similarity
  7 Jan 2021 · 0 repositories · arXiv:2101.02351
• I-BERT: Integer-only BERT Quantization
  5 Jan 2021 · 7 repositories · arXiv:2101.01321
• Task-Agnostic and Adaptive-Size BERT Compression
  1 Jan 2021 · 0 repositories
• Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning
  31 Dec 2020 · 1 repository · arXiv:2012.15699
• MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
  31 Dec 2020 · 2 repositories · arXiv:2012.15828
• ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning
  30 Dec 2020 · 2 repositories · arXiv:2012.15283
• Optimizing Deeper Transformers on Small Datasets
  30 Dec 2020 · 1 repository · arXiv:2012.15355
• UnNatural Language Inference
  30 Dec 2020 · 1 repository · arXiv:2101.00010
• Syntax-Enhanced Pre-trained Model
  28 Dec 2020 · 1 repository · arXiv:2012.14116
• To what extent do human explanations of model behavior align with actual model behavior?
  24 Dec 2020 · 0 repositories · arXiv:2012.13354
• Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
  22 Dec 2020 · 2 repositories · arXiv:2012.13255
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
• Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems
  22 Dec 2020 · 1 repository · arXiv:2012.11937
• Recognizing Emotion Cause in Conversations
  22 Dec 2020 · 1 repository · arXiv:2012.11820
• MASKER: Masked Keyword Regularization for Reliable Text Classification
  17 Dec 2020 · 1 repository · arXiv:2012.09392
• MIX : a Multi-task Learning Approach to Solve Open-Domain Question Answering
  17 Dec 2020 · 0 repositories · arXiv:2012.09766
• Yelp Review Rating Prediction: Machine Learning and Deep Learning Models
  12 Dec 2020 · 1 repository · arXiv:2012.06690
• Detecting Insincere Questions from Text: A Transfer Learning Approach
  7 Dec 2020 · 1 repository · arXiv:2012.07587
• KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning
  7 Dec 2020 · 0 repositories · arXiv:2012.03551
• Pre-training Protein Language Models with Label-Agnostic Binding Pairs Enhances Performance in Downstream Tasks
  5 Dec 2020 · 1 repository · arXiv:2012.03084
• GottBERT: a pure German Language Model
  3 Dec 2020 · 0 repositories · arXiv:2012.02110
• Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation
  1 Dec 2020 · 0 repositories
• Detecting Urgency Status of Crisis Tweets: A Transfer Learning Approach for Low Resource Languages
  1 Dec 2020 · 1 repository
• Evaluating Pretrained Transformer-based Models on the Task of Fine-Grained Named Entity Recognition
  1 Dec 2020 · 0 repositories
• Evaluating Unsupervised Representation Learning for Detecting Stances of Fake News
  1 Dec 2020 · 0 repositories
• FASTMATCH: Accelerating the Inference of BERT-based Text Matching
  1 Dec 2020 · 0 repositories
• From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks
  1 Dec 2020 · 1 repository
• HinglishNLP at SemEval-2020 Task 9: Fine-tuned Language Models for Hinglish Sentiment Detection
  1 Dec 2020 · 2 repositories
• Hitachi at SemEval-2020 Task 11: An Empirical Study of Pre-Trained Transformer Family for Propaganda Detection
  1 Dec 2020 · 0 repositories
• HR@JUST Team at SemEval-2020 Task 4: The Impact of RoBERTa Transformer for Evaluation Common Sense Understanding
  1 Dec 2020 · 0 repositories
• LT3 at SemEval-2020 Task 7: Comparing Feature-Based and Transformer-Based Approaches to Detect Funny Headlines
  1 Dec 2020 · 0 repositories
• Masked Reasoner at SemEval-2020 Task 4: Fine-Tuning RoBERTa for Commonsense Reasoning
  1 Dec 2020 · 0 repositories
• Syntactically Aware Cross-Domain Aspect and Opinion Terms Extraction
  1 Dec 2020 · 0 repositories
• Team Solomon at SemEval-2020 Task 4: Be Reasonable: Exploiting Large-scale Language Models for Commonsense Reasoning
  1 Dec 2020 · 0 repositories
• TextLearner at SemEval-2020 Task 10: A Contextualized Ranking System in Solving Emphasis Selection in Text
  1 Dec 2020 · 0 repositories
• TheNorth at SemEval-2020 Task 12: Hate Speech Detection Using RoBERTa
  1 Dec 2020 · 0 repositories
• TTUI at SemEval-2020 Task 11: Propaganda Detection with Transfer Learning and Ensembles
  1 Dec 2020 · 0 repositories
• UI at SemEval-2020 Task 4: Commonsense Validation and Explanation by Exploiting Contradiction
  1 Dec 2020 · 0 repositories
• UoR at SemEval-2020 Task 4: Pre-trained Sentence Transformer Models for Commonsense Validation and Explanation
  1 Dec 2020 · 0 repositories
• A Novel Sentiment Analysis Engine for Preliminary Depression Status Estimation on Social Media
  29 Nov 2020 · 0 repositories · arXiv:2011.14280
• Transformer Query-Target Knowledge Discovery (TEND): Drug Discovery from CORD-19
  28 Nov 2020 · 0 repositories · arXiv:2012.04682
• Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation
  26 Nov 2020 · 0 repositories · arXiv:2011.13187
• Detection and Classification of mental illnesses on social media using RoBERTa
  23 Nov 2020 · 0 repositories · arXiv:2011.11226
• Multitask Learning of Negation and Speculation using Transformers
  20 Nov 2020 · 1 repository
• Do Fine-tuned Commonsense Language Models Really Generalize?
  18 Nov 2020 · 0 repositories · arXiv:2011.09159
• NIT COVID-19 at WNUT-2020 Task 2: Deep Learning Model RoBERTa for Identify Informative COVID-19 English Tweets
  11 Nov 2020 · 0 repositories · arXiv:2011.05551
• UmBERTo-MTSA @ AcCompl-It: Improving Complexity and Acceptability Prediction with Multi-task Learning on Self-Supervised Annotations
  10 Nov 2020 · 1 repository · arXiv:2011.05197
• When Do You Need Billions of Words of Pretraining Data?
  10 Nov 2020 · 1 repository · arXiv:2011.04946
• Positional Artefacts Propagate Through Masked Language Model Embeddings
  9 Nov 2020 · 0 repositories · arXiv:2011.04393
• A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English
  2 Nov 2020 · 1 repository · arXiv:2011.00960
• Introducing various Semantic Models for Amharic: Experimentation and Evaluation with multiple Tasks and Datasets
  2 Nov 2020 · 1 repository · arXiv:2011.01154
• Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis
  1 Nov 2020 · 0 repositories · arXiv:2011.00476
• A Sui Generis QA Approach using RoBERTa for Adverse Drug Event Identification
  30 Oct 2020 · 0 repositories · arXiv:2011.00057
• A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge
  27 Oct 2020 · 0 repositories · arXiv:2010.14202
• Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL
  23 Oct 2020 · 1 repository · arXiv:2010.12634
• ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
  23 Oct 2020 · 2 repositories · arXiv:2010.12148
• Topic Modeling with Contextualized Word Representation Clusters
  23 Oct 2020 · 0 repositories · arXiv:2010.12626
• UniCase -- Rethinking Casing in Language Models
  22 Oct 2020 · 0 repositories · arXiv:2010.11936
• Detection of COVID-19 informative tweets using RoBERTa
  21 Oct 2020 · 0 repositories · arXiv:2010.11238
• AutoMeTS: The Autocomplete for Medical Text Simplification
  20 Oct 2020 · 1 repository · arXiv:2010.10573
• ConjNLI: Natural Language Inference Over Conjunctive Sentences
  20 Oct 2020 · 1 repository · arXiv:2010.10418
  Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
• Explaining and Improving Model Behavior with k Nearest Neighbor Representations
  18 Oct 2020 · 0 repositories · arXiv:2010.09030
• Linguistically-Informed Transformations (LIT): A Method for Automatically Generating Contrast Sets
  16 Oct 2020 · 0 repositories · arXiv:2010.08580
• Neural Deepfake Detection with Factual Structure of Text
  15 Oct 2020 · 1 repository · arXiv:2010.07475
• Aspect-based Document Similarity for Research Papers
  13 Oct 2020 · 1 repository · arXiv:2010.06395
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Chatbot Interaction with Artificial Intelligence: Human Data Augmentation with T5 and Language Transformer Ensemble for Text Classification
  12 Oct 2020 · 0 repositories · arXiv:2010.05990
• EFSG: Evolutionary Fooling Sentences Generator
  12 Oct 2020 · 0 repositories · arXiv:2010.05736
• From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks
  12 Oct 2020 · 1 repository · arXiv:2010.05648
  Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
• Probing Pretrained Language Models for Lexical Semantics
  12 Oct 2020 · 0 repositories · arXiv:2010.05731
• Data Agnostic RoBERTa-based Natural Language to SQL Query Generation
  11 Oct 2020 · 1 repository · arXiv:2010.05243
• Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
  11 Oct 2020 · 1 repository · arXiv:2010.05358
• Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings
  10 Oct 2020 · 0 repositories · arXiv:2010.05002
• NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training
  9 Oct 2020 · 1 repository · arXiv:2010.04335
• Deep Learning Meets Projective Clustering
  8 Oct 2020 · 0 repositories · arXiv:2010.04290
• On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers
  6 Oct 2020 · 0 repositories · arXiv:2010.02616
• How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?
  5 Oct 2020 · 0 repositories · arXiv:2010.01764
• Self-training Improves Pre-training for Natural Language Understanding
  5 Oct 2020 · 1 repository · arXiv:2010.02194
• Mining Knowledge for Natural Language Inference from Wikipedia Categories
  3 Oct 2020 · 1 repository · arXiv:2010.01239
  Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)