Methods › Natural Language Processing › Transformers › RoBERTa › Papers, page 7
RoBERTa
Papers archive 2025-07-28
archive papers tagged: 913 · with a code link: 399 · where Syntology ran a sample: 87 (66 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (87 of 913 tagged: 66 with a run with no instrument failure, 21 where every run was a failure of Syntology's instrument)
Page 7 of 10: papers 601 to 700 of 913, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens 25 Aug 2021 · 1 repository · arXiv:2108.11193Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
Sarcasm Detection in Twitter -- Performance Impact while using Data Augmentation: Word Embeddings 23 Aug 2021 · 1 repository · arXiv:2108.09924
-
Maps Search Misspelling Detection Leveraging Domain-Augmented Contextual Representations 15 Aug 2021 · 0 repositories · arXiv:2108.06842
-
A Study of Social and Behavioral Determinants of Health in Lung Cancer Patients Using Transformers-based Natural Language Processing Models 10 Aug 2021 · 0 repositories · arXiv:2108.04949
-
FiLMing Multimodal Sarcasm Detection with Attention 9 Aug 2021 · 1 repository · arXiv:2110.00416
-
HTTP2vec: Embedding of HTTP Requests for Detection of Anomalous Traffic 3 Aug 2021 · 0 repositories · arXiv:2108.01763
-
1213Li at SemEval-2021 Task 6: Detection of Propaganda with Multi-modal Attention and Pre-trained Models 1 Aug 2021 · 0 repositories
-
ADEPT: An Adjective-Dependent Plausibility Task 1 Aug 2021 · 0 repositories
-
AStarTwice at SemEval-2021 Task 5: Toxic Span Detection Using RoBERTa-CRF, Domain Specific Pre-Training and Self-Training 1 Aug 2021 · 0 repositories
-
BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks 1 Aug 2021 · 1 repository
-
Can Transformer Models Measure Coherence In Text: Re-Thinking the Shuffle Test 1 Aug 2021 · 0 repositories
-
Cross-lingual Evidence Improves Monolingual Fake News Detection 1 Aug 2021 · 1 repository
-
CSECU-DSG at SemEval-2021 Task 1: Fusion of Transformer Models for Lexical Complexity Prediction 1 Aug 2021 · 0 repositories
-
CSECU-DSG at SemEval-2021 Task 7: Detecting and Rating Humor and Offense Employing Transformers 1 Aug 2021 · 0 repositories
-
DeepBlueAI at SemEval-2021 Task 7: Detecting and Rating Humor and Offense with Stacking Diverse Language Model-Based Methods 1 Aug 2021 · 0 repositories
-
DLJUST at SemEval-2021 Task 7: Hahackathon: Linking Humor and Offense 1 Aug 2021 · 0 repositories
-
ES-JUST at SemEval-2021 Task 7: Detecting and Rating Humor and Offensive Text Using Deep Learning 1 Aug 2021 · 0 repositories
-
GhostBERT: Generate More Features with Cheap Operations for BERT 1 Aug 2021 · 0 repositories
-
Grenzlinie at SemEval-2021 Task 7: Detecting and Rating Humor and Offense 1 Aug 2021 · 0 repositories
-
Gulu at SemEval-2021 Task 7: Detecting and Rating Humor and Offense 1 Aug 2021 · 0 repositories
-
HamiltonDinggg at SemEval-2021 Task 5: Investigating Toxic Span Detection using RoBERTa Pre-training 1 Aug 2021 · 0 repositories
-
hub at SemEval-2021 Task 1: Fusion of Sentence and Word Frequency to Predict Lexical Complexity 1 Aug 2021 · 0 repositories
-
hub at SemEval-2021 Task 2: Word Meaning Similarity Prediction Model Based on RoBERTa and Word Frequency 1 Aug 2021 · 0 repositories
-
JUST-BLUE at SemEval-2021 Task 1: Predicting Lexical Complexity using BERT and RoBERTa Pre-trained Language Models 1 Aug 2021 · 0 repositories
-
LeCun at SemEval-2021 Task 6: Detecting Persuasion Techniques in Text Using Ensembled Pretrained Transformers and Data Augmentation 1 Aug 2021 · 0 repositories
-
LIORI at SemEval-2021 Task 8: Ask Transformer for measurements 1 Aug 2021 · 0 repositories
-
MedAI at SemEval-2021 Task 5: Start-to-end Tagging Framework for Toxic Spans Detection 1 Aug 2021 · 0 repositories
-
MinD at SemEval-2021 Task 6: Propaganda Detection using Transfer Learning and Multimodal Fusion 1 Aug 2021 · 0 repositories
-
NLPIITR at SemEval-2021 Task 6: RoBERTa Model with Data Augmentation for Persuasion Techniques Detection 1 Aug 2021 · 0 repositories
-
NLyticsFKIE at SemEval-2021 Task 6: Detection of Persuasion Techniques In Texts And Images 1 Aug 2021 · 0 repositories
-
PAW at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation : Exploring Cross Lingual Transfer, Augmentations and Adversarial Training 1 Aug 2021 · 0 repositories
-
RG PA at SemEval-2021 Task 1: A Contextual Attention-based Model with RoBERTa for Lexical Complexity Prediction 1 Aug 2021 · 0 repositories
-
SarcasmDet at SemEval-2021 Task 7: Detect Humor and Offensive based on Demographic Factors using RoBERTa Pre-trained Model 1 Aug 2021 · 0 repositories
-
Sefamerve ARGE at SemEval-2021 Task 5: Toxic Spans Detection Using Segmentation Based 1-D Convolutional Neural Network Model 1 Aug 2021 · 1 repository
-
SkoltechNLP at SemEval-2021 Task 5: Leveraging Sentence-level Pre-training for Toxic Span Detection 1 Aug 2021 · 0 repositories
-
YNU-HPCC at SemEval-2021 Task 5: Using a Transformer-based Model with Auxiliary Information for Toxic Span Detection 1 Aug 2021 · 1 repository
-
YoungSheldon at SemEval-2021 Task 5: Fine-tuning Pre-trained Language Models for Toxic Spans Detection using Token classification Objective 1 Aug 2021 · 1 repository
-
Improved Text Classification via Contrastive Adversarial Training 21 Jul 2021 · 0 repositories · arXiv:2107.10137
-
Clinical Relation Extraction Using Transformer-based Models 19 Jul 2021 · 1 repository · arXiv:2107.08957
-
A Vector-Based Approach to Few-Shot Veracity Classification for Automated Fact-Checking 17 Jul 2021 · 0 repositories
-
Neural Search: Learning Query and Product Representations in Fashion E-commerce 17 Jul 2021 · 0 repositories · arXiv:2107.08291
-
FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark 15 Jul 2021 · 1 repository · arXiv:2107.07498
-
Trusting RoBERTa over BERT: Insights from CheckListing the Natural Language Inference Task 15 Jul 2021 · 1 repository · arXiv:2107.07229
-
What do writing features tell us about AI papers? 13 Jul 2021 · 1 repository · arXiv:2107.06310
-
A Review of Bangla Natural Language Processing Tasks and the Utility of Transformer Models 8 Jul 2021 · 2 repositories · arXiv:2107.03844
-
Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test 7 Jul 2021 · 1 repository · arXiv:2107.03448
-
Leveraging Domain Agnostic and Specific Knowledge for Acronym Disambiguation 1 Jul 2021 · 0 repositories · arXiv:2107.00316
-
Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLU 28 Jun 2021 · 0 repositories · arXiv:2106.14464
-
Benchmarking Differential Privacy and Federated Learning for BERT Models 26 Jun 2021 · 1 repository · arXiv:2106.13973
-
Context-Aware Legal Citation Recommendation using Deep Learning 20 Jun 2021 · 1 repository · arXiv:2106.10776
-
LoRA: Low-Rank Adaptation of Large Language Models 17 Jun 2021 · 74 repositories · arXiv:2106.09685Syntology community repositories only · 51 ran (of which 19 constructed an object rather than computing a result; 44 with no instrument failure: 1 honoured, 0 violated, 43 with no contract checked; 7 where Syntology's instrument failed) · 33 unverified (of 84 harvested samples) · 30 pointer-only (licence)
-
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark 15 Jun 2021 · 2 repositories · arXiv:2106.08087Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 2 pointer-only (licence)
-
Why Can You Lay Off Heads? Investigating How BERT Heads Transfer 14 Jun 2021 · 0 repositories · arXiv:2106.07137
-
BERT-Based Sentiment Analysis: A Software Engineering Perspective 4 Jun 2021 · 2 repositories · arXiv:2106.02581
-
belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification 2 Jun 2021 · 0 repositories · arXiv:2106.01091
-
On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers 2 Jun 2021 · 0 repositories · arXiv:2106.01335
-
Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis 1 Jun 2021 · 0 repositories
-
Dual-Objective Fine-Tuning of BERT for Entity Matching 1 Jun 2021 · 1 repository
-
HONEST: Measuring Hurtful Sentence Completion in Language Models 1 Jun 2021 · 1 repository
-
On using distributed representations of source code for the detection of C security vulnerabilities 1 Jun 2021 · 1 repository · arXiv:2106.01367
-
Shuffled-token Detection for Refining Pre-trained RoBERTa 1 Jun 2021 · 0 repositories
-
Towards a Comprehensive Understanding and Accurate Evaluation of Societal Biases in Pre-Trained Transformers 1 Jun 2021 · 0 repositories
-
WikiTalkEdit: A Dataset for modeling Editors' behaviors on Wikipedia 1 Jun 2021 · 0 repositories
-
How transfer learning impacts linguistic knowledge in deep NLP models? 31 May 2021 · 0 repositories · arXiv:2105.15179
-
Zero-shot Fact Verification by Claim Generation 31 May 2021 · 1 repository · arXiv:2105.14682Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Neural Models for Offensive Language Detection 30 May 2021 · 0 repositories · arXiv:2106.14609
-
RobeCzech: Czech RoBERTa, a monolingual contextualized language representation model 24 May 2021 · 0 repositories · arXiv:2105.11314
-
Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models 24 May 2021 · 0 repositories · arXiv:2105.11136
-
Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers 16 May 2021 · 0 repositories
-
How is BERT surprised? Layerwise detection of linguistic anomalies 16 May 2021 · 1 repository · arXiv:2105.07452
-
Evaluating Gender Bias in Natural Language Inference 12 May 2021 · 1 repository · arXiv:2105.05541
-
Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense 12 May 2021 · 0 repositories · arXiv:2105.05913
-
Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layouts 12 May 2021 · 0 repositories · arXiv:2105.05796
-
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation 12 May 2021 · 1 repository · arXiv:2105.05912
-
BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies? 11 May 2021 · 1 repository · arXiv:2105.04949
-
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models 10 May 2021 · 0 repositories · arXiv:2105.04688
-
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality 7 May 2021 · 1 repository · arXiv:2105.03484
-
MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories 28 Apr 2021 · 1 repository · arXiv:2104.13615Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter 27 Apr 2021 · 0 repositories · arXiv:2104.13164
-
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding 26 Apr 2021 · 5 repositories · arXiv:2104.12763Syntology community repositories only · 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)
-
Comparative Analysis of Machine Learning and Deep Learning Algorithms for Detection of Online Hate Speech 23 Apr 2021 · 0 repositories · arXiv:2108.01063
-
Optimizing small BERTs trained for German NER 23 Apr 2021 · 2 repositories · arXiv:2104.11559
-
Discriminative Self-training for Punctuation Prediction 21 Apr 2021 · 0 repositories · arXiv:2104.10339
-
Efficient pre-training objectives for Transformers 20 Apr 2021 · 0 repositories · arXiv:2104.09694
-
Subsentence Extraction from Text Using Coverage-Based Deep Learning Language Models 20 Apr 2021 · 1 repository · arXiv:2104.09777
-
Modeling "Newsworthiness" for Lead-Generation Across Corpora 19 Apr 2021 · 0 repositories · arXiv:2104.09653
-
TeamUNCC@LT-EDI-EACL2021: Hope Speech Detection using Transfer Learning with Transformers 19 Apr 2021 · 1 repository
-
The Topic Confusion Task: A Novel Scenario for Authorship Attribution 17 Apr 2021 · 0 repositories · arXiv:2104.08530
-
Probing Across Time: What Does RoBERTa Know and When? 16 Apr 2021 · 1 repository · arXiv:2104.07885Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
BERT based Transformers lead the way in Extraction of Health Information from Social Media 15 Apr 2021 · 1 repository · arXiv:2104.07367
-
TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction 15 Apr 2021 · 1 repository · arXiv:2104.07244
-
UIT-E10dot3 at SemEval-2021 Task 5: Toxic Spans Detection with Named Entity Recognition and Question-Answering Approaches 15 Apr 2021 · 0 repositories · arXiv:2104.07376
-
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa 11 Apr 2021 · 1 repository · arXiv:2104.04986
-
UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost 11 Apr 2021 · 0 repositories · arXiv:2104.04946
-
Transformers: "The End of History" for NLP? 9 Apr 2021 · 0 repositories · arXiv:2105.00813
-
Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA 5 Apr 2021 · 0 repositories · arXiv:2104.02041
-
Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding 5 Apr 2021 · 0 repositories · arXiv:2104.02138
-
Content-based Models of Quotation 1 Apr 2021 · 0 repositories
-
NLQuAD: A Non-Factoid Long Question Answering Data Set 1 Apr 2021 · 1 repository
-
Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependencies 29 Mar 2021 · 0 repositories · arXiv:2103.15737