Browse State-of-the-Art › Lexical Analysis
Lexical Analysis
8 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Lexical analysis is the process of converting a sequence of characters into a sequence of tokens (strings with an assigned and thus identified meaning). (Source: Adapted from Wikipedia)
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 56 · with a code link: 8 · where Syntology ran a sample: 0 (0 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran: none of the 56 tagged papers has a Syntology run on record
Page 1 of 1: papers 1 to 56 of 56, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
4 Jun 2021 2 repositories listedThis paper describes the performance of the team cs60075_team2 at SemEval 2021 Task 1 - Lexical Complexity Prediction.
-
5 Jul 2018 2 repositories listedLexical analysis is believed to be a crucial step towards natural language understanding and has been widely studied.
-
3 Oct 2024 1 repository listedLexical tones play a crucial role in Sino-Tibetan languages.
-
16 Aug 2022 1 repository listedThrough a hierarchical clustering of the data in this lower-dimensional space, this method yields clear cultural areas and the topics of discussion that define them.
-
1 Jan 2021 1 repository listedThe results reported in this paper aim to increase the presence of the Uzbek language in the Internet and its usability within IT applications.
-
24 Sep 2020 1 repository listedWe introduce N-LTP, an open-source neural language technology platform supporting six fundamental Chinese NLP tasks: {lexical analysis} (Chinese word segmentation, part-of-speech tagging, and named entity recognition)…
-
26 Sep 2019 1 repository listedWe apply this framework to existing datasets and models and show that: (1) the pivot words are strong features for the classification of sentence attributes; (2) to change the attribute of a sentence, many datasets only…
-
5 Feb 2015 1 repository listedBased on the Aristotelian concept of potentiality vs. actuality allowing for the study of energy and dynamics in language, we propose a field approach to lexical analysis.
-
A Tale of Two Identities: An Ethical Audit of Human and AI-Crafted Personas7 May 2025 0 repositories listedAs LLMs (large language models) are increasingly used to generate synthetic personas particularly in data-limited domains such as health, privacy, and HCI, it becomes necessary to understand how these narratives…
-
Polarization and Morality: Lexical Analysis of Abortion Discourse on Reddit29 Jun 2024 0 repositories listedThis study investigates whether division on political topics is mapped with the distinctive patterns of language use.
-
Computational lexical analysis of Flamenco genres9 May 2024 0 repositories listedFlamenco, recognized by UNESCO as part of the Intangible Cultural Heritage of Humanity, is a profound expression of cultural identity rooted in Andalusia, Spain.
-
Towards Lexical Analysis of Dog Vocalizations via Online Videos21 Sep 2023 0 repositories listedDeciphering the semantics of animal language has been a grand challenge.
-
Leveraging Natural Language Processing For Public Health Screening On YouTube: A COVID-19 Case Study1 Jun 2023 0 repositories listedBackground: Social media platforms have become a viable source of medical information, with patients and healthcare professionals using them to share health-related information and track diseases.
-
Happy or grumpy? A Machine Learning Approach to Analyze the Sentiment of Airline Passengers' Tweets28 Sep 2022 0 repositories listedAs one of the most extensive social networking services, Twitter has more than 300 million active users as of 2022.
-
Analyse Automatique de l’Ancien Arménien. Évaluation d’une méthode hybride « dictionnaire » et « réseau de neurones » sur un Extrait de l’Adversus Haereses d’Irénée de Lyon1 Jun 2022 0 repositories listedThe aim of this paper is to evaluate a lexical analysis (mainly lemmatization and POS-tagging) of a sample of the Ancient Armenian version of the Adversus Haereses by Irenaeus of Lyons (2nd c.)
-
CV4Code: Sourcecode Understanding via Visual Code Representations11 May 2022 0 repositories listedWe present CV4Code, a compact and effective computer vision method for sourcecode understanding.
-
Effect and Analysis of Large-scale Language Model Rescoring on Competitive ASR Systems1 Apr 2022 0 repositories listedLarge-scale language models (LLMs) such as GPT-2, BERT and RoBERTa have been successfully applied to ASR N-best rescoring.
-
Evaluating Persian Tokenizers22 Feb 2022 0 repositories listedTokenization plays a significant role in the process of lexical analysis.
-
COVID-19 and Misinformation: A Large-Scale Lexical Analysis on Twitter1 Aug 2021 0 repositories listedSocial media is often used by individuals and organisations as a platform to spread misinformation.
-
Visual Exploration and Knowledge Discovery from Biomedical Dark Data28 Sep 2020 0 repositories listedData visualization techniques proffer efficient means to organize and present data in graphically appealing formats, which not only speeds up the process of decision making and pattern recognition but also enables…
-
Integration of Automatic Sentence Segmentation and Lexical Analysis of Ancient Chinese based on BiLSTM-CRF Model1 May 2020 0 repositories listedThe basic tasks of ancient Chinese information processing include automatic sentence segmentation, word segmentation, part-of-speech tagging and named entity recognition.
-
Processing Language Resources of Under-Resourced and Endangered Languages for the Generation of Augmentative Alternative Communication Boards1 May 2020 0 repositories listedUnder-resourced and endangered or small languages yield problems for automatic processing and exploiting because of the small amount of available data.
-
An Intelligent Data Analysis for Hotel Recommendation Systems using Machine Learning15 Oct 2019 0 repositories listedThis paper presents an intelligent approach to handle heterogeneous and large-sized data using machine learning to generate true recommendations for the future customers.
-
Recognizing Topic Change in Search Sessions of Digital Libraries based on Thesaurus and Classification System24 Sep 2019 0 repositories listedLog analysis in Web search showed that user sessions often contain several different topics.
-
Corpus Lexicography in a Wider Context1 Sep 2019 0 repositories listedThis paper describes a set of tools that offers comprehensive solutions for corpus lexicography.
-
LEGATO: A flexible lexicographic annotation tool1 Sep 2019 0 repositories listedThis article is a report from an ongoing project aiming at analyzing lexical and grammatical competences of Swedish as a Second language (L2).
-
A Comprehensive Analysis of Twitter Trending Topics21 Jul 2019 0 repositories listedIn Twitter, a name, phrase, or topic that is mentioned at a greater rate than others is called a "trending topic" or simply "trend".
-
The Truth and Nothing but the Truth: Multimodal Analysis for Deception Detection11 Mar 2019 0 repositories listedWe propose a data-driven method for automatic deception detection in real-life trial data using visual and verbal cues.
-
Content Extraction and Lexical Analysis from Customer-Agent Interactions1 Nov 2018 0 repositories listedIn this paper, we provide a lexical comparative analysis of the vocabulary used by customers and agents in an Enterprise Resource Planning (ERP) environment and a potential solution to clean the data and extract…
-
Multitask and Multilingual Modelling for Lexical Analysis7 Sep 2018 0 repositories listedIn Natural Language Processing (NLP), one traditionally considers a single task (e.g. part-of-speech tagging) for a single language (e.g. English) at a time.
-
TRAPACC and TRAPACCS at PARSEME Shared Task 2018: Neural Transition Tagging of Verbal Multiword Expressions1 Aug 2018 0 repositories listed
-
Automatic Annotation of Semantic Term Types in the Complete ACL Anthology Reference Corpus1 May 2018 0 repositories listed
-
Towards a music-language mapping1 May 2018 0 repositories listed
-
One Model to Rule them all: Multitask and Multilingual Modelling for Lexical Analysis3 Nov 2017 0 repositories listed
-
Deep Learning in Lexical Analysis and Parsing1 Nov 2017 0 repositories listed
-
Benchmarking Joint Lexical and Syntactic Analysis on Multiword-Rich Data1 Apr 2017 0 repositories listed
-
Parsing and MWE Detection: Fips at the PARSEME Shared Task1 Apr 2017 0 repositories listed
-
The ATILF-LLF System for Parseme Shared Task: a Transition-based Verbal Multiword Expression Tagger1 Apr 2017 0 repositories listed
-
Sarcasm Detection : Building a Contextual Hierarchy1 Dec 2016 0 repositories listed
-
Detecting Mild Cognitive Impairment by Exploiting Linguistic Information from Transcripts1 Aug 2016 0 repositories listed
-
Deep Lexical Segmentation and Syntactic Parsing in the Easy-First Dependency Framework1 Jun 2016 0 repositories listed
-
Lifetime Achievement Award: Translating Today into Tomorrow1 Dec 2015 0 repositories listed
-
Ontology Based SMS Controller for Smart Phones4 Sep 2015 0 repositories listed
-
Lexical Characteristics Analysis of Chinese Clinical Documents1 Jul 2015 0 repositories listed
-
Noun Paraphrasing Based on a Variety of Contexts1 Dec 2014 0 repositories listed
-
Dependency Parsing: Past, Present, and Future1 Aug 2014 0 repositories listed
-
BACANAL: Short Length Random Walks For Lexical Analysis, Application to lexical substitution (BACANAL : Balades Aléatoires Courtes pour ANAlyses Lexicales Application à la substitution lexicale) [in French]1 Jul 2014 0 repositories listed
-
Augmenting FrameNet Via PPDB1 Jun 2014 0 repositories listed
-
Toward Macro-Insights for Suicide Prevention: Analyzing Fine-Grained Distress at Scale1 Jun 2014 0 repositories listed
-
Terminology localization guidelines for the national scenario1 May 2014 0 repositories listed
-
Corpus-driven Lexical Analysis: Norms and Exploitations in Word Use1 Nov 2013 0 repositories listed
-
Selecting Proper Lexical Paraphrase for Children1 Oct 2013 0 repositories listed
-
History Based Unsupervised Data Oriented Parsing1 Sep 2013 0 repositories listed
-
Toward an amazigh language processing1 Dec 2012 0 repositories listed
-
On using context for automatic correction of non-word misspellings in student essays1 Jun 2012 0 repositories listed
-
Large Scale Lexical Analysis1 May 2012 0 repositories listed
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections