Browse State-of-the-Art › Sign Language Translation
Sign Language Translation
56 papers with code · 6 benchmarks · 17 datasets archive 2025-07-28
Given a video containing sign language, the task is to predict the translation into (written) spoken language.
Image credit: How2Sign
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): CSL-Daily (1 judged, 0 placed), How2Sign (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
17 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 153 · with a code link: 56 · where Syntology ran a sample: 13 (13 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (13 of 153 tagged: 13 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 153, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 Mar 2022 4 repositories listed Syntology community repositories only · 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples) · 9 pointer-only (licence)Concretely, we pretrain the sign-to-gloss visual network on the general domain of human actions and the within-domain of a sign-to-gloss dataset, and pretrain the gloss-to-text translation network on the general domain…
-
24 Oct 2019 3 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)Based on this new large-scale dataset, we are able to experiment with several deep learning methods for word-level sign recognition and evaluate their performances in large scale scenarios.
-
20 Sep 2023 2 repositories listedWe introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system.
-
28 May 2023 2 repositories listedSign language translation systems are complex and require many components.
-
12 Oct 2020 2 repositories listed Syntology official (archive's flag): 3 ran · 6 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 3 pointer-only (licence)Sign language translation (SLT) aims to interpret sign video sequences into text-based natural language sentences.
-
30 Mar 2020 2 repositories listed Syntology official (archive's flag): 5 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)We report state-of-the-art sign language recognition and translation results achieved by our Sign Language Transformers.
-
30 May 2025 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)This work demonstrates the potential of hyperbolic geometry to improve skeletal representations for Sign Language Translation, improving on SOTA RGB methods while preserving privacy and improving computational…
-
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model30 May 2025 1 repository listedSign Language Translation (SLT) aims to convert sign language (SL) videos into spoken language text, thereby bridging the communication gap between the sign and the spoken community.
-
9 Mar 2025 1 repository listedAccurate sign language understanding serves as a crucial communication channel for individuals with disabilities.
-
25 Jan 2025 1 repository listed Syntology official (archive's flag): 14 ran · 14 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 1 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples) · 15 pointer-only (licence)Sign language pre-training has gained increasing attention for its ability to enhance performance across various sign language understanding (SLU) tasks.
-
21 Dec 2024 1 repository listedThe human body communicates through various meaningful gestures, with sign language using hands being a prominent example.
-
12 Dec 2024 1 repository listedIn this work, we propose a novel method combining joint CTC/Attention and transfer learning.
-
19 Nov 2024 1 repository listedSign language translation, especially in gloss-free paradigm, is confronting a dilemma of impracticality and unsustainability due to growing resource-intensive methodologies.
-
25 Oct 2024 1 repository listedIn this work, we introduce a Diverse Sign Language Translation (DivSLT) task, aiming to generate diverse yet accurate translations for sign language videos.
-
18 Oct 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)This paper presents the first comprehensive interpretability analysis of a Transformer-based Sign Language Translation (SLT) model, focusing on the translation from video-based Greek Sign Language to glosses and text.
-
13 Sep 2024 1 repository listedThis project explores methods to enhance sign language translation of German sign language, specifically focusing on disambiguation of homonyms.
-
3 Sep 2024 1 repository listedThe limited amount of labeled data for training the Brazilian Sign Language (Libras) to Portuguese Translation models is a challenging problem due to video collection and annotation costs.
-
20 Aug 2024 1 repository listedWith this in mind, we introduce Spatial and Motion-based Sign Language Translation (SpaMo), a novel LLM-based SLT framework.
-
20 Aug 2024 1 repository listedBased on this dataset and several other large-scale datasets, we propose a novel baseline method that fully leverages the Mamba model's ability to integrate temporal information of CNN features, resulting in improved…
-
17 Aug 2024 1 repository listedThis paper introduces an open-source interface for American Sign Language fingerspell recognition and semantic pose retrieval, aimed to serve as a stepping stone towards more advanced sign language translation systems.
-
14 Aug 2024 1 repository listedState-of-the-art sign language translation (SLT) systems facilitate the learning process through gloss annotations, either in an end2end manner or by involving an intermediate step.
-
1 Jul 2024 1 repository listedSign language translation from video to spoken text presents unique challenges owing to the distinct grammar, expression nuances, and high variation of visual appearance across different speakers and contexts.
-
10 Jun 2024 1 repository listedSign languages are multi-channel languages that communicate information through not just the hands (manual signals) but also facial expressions and upper body movements (non-manual signals).
-
23 May 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this paper, we identify a representation density problem that could be a bottleneck in restricting the performance of gloss-free SLT.
-
9 May 2024 1 repository listedThe resulting framework is denoted as MSKA-SLR, which is expanded into a sign language translation (SLT) model through the straightforward addition of an extra translation network.
-
17 Apr 2024 1 repository listedIn specific, CorrNet+ employs a correlation module and an identification module to build human body trajectories.
-
19 Mar 2024 1 repository listedAlthough some approaches work towards gloss-free SLT through jointly training the visual encoder and translation network, these efforts still suffer from poor performance and inefficient use of the powerful Large…
-
29 Feb 2024 1 repository listedWe introduce Mediapi-RGB, a new dataset of French Sign Language (LSF) along with the first LSF-to-French machine translation model.
-
14 Feb 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples) · 12 pointer-only (licence)A major impediment to the advancement of sign language translation (SLT) is data scarcity.
-
9 Jan 2024 1 repository listedThe objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation.
-
25 Dec 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
20 Nov 2023 1 repository listed
-
16 Nov 2023 1 repository listed
-
27 Jul 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
14 Jul 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
11 Jul 2023 1 repository listed
-
22 May 2023 1 repository listed
-
18 May 2023 1 repository listed
-
2 May 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
21 Apr 2023 1 repository listed
-
13 Apr 2023 1 repository listed
-
1 Apr 2023 1 repository listed
-
2 Dec 2022 1 repository listed
-
14 Nov 2022 1 repository listed
-
2 Nov 2022 1 repository listed
-
11 Oct 2022 1 repository listed
-
25 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
12 Apr 2022 1 repository listed
-
11 Apr 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
1 Sep 2021 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
20 Aug 2021 1 repository listed
-
18 Aug 2020 1 repository listed
-
10 Apr 2020 1 repository listed
-
1 Apr 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 1 pointer-only (licence)
-
1 Jun 2018 1 repository listed
-
Speak2Sign3D: A Multi-modal Pipeline for English Speech to American Sign Language Animation9 Jul 2025 0 repositories listed
-
Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation21 May 2025 0 repositories listed
-
ADAT: Time-Series-Aware Adaptive Transformer Architecture for Sign Language Translation16 Apr 2025 0 repositories listed
-
Hands-On: Segmenting Individual Signs from Continuous Sequences11 Apr 2025 0 repositories listed
-
A multitask transformer to sign language translation using motion gesture primitives25 Mar 2025 0 repositories listed
-
Spatio-temporal transformer to support automatic sign language translation4 Feb 2025 0 repositories listed
-
Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues16 Jan 2025 0 repositories listed
-
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility9 Jan 2025 0 repositories listed
-
Learning Sign Language Representation using CNN LSTM, 3DCNN, CNN RNN LSTM and CCN TD24 Dec 2024 0 repositories listed
-
LLaVA-SLT: Visual Language Tuning for Sign Language Translation21 Dec 2024 0 repositories listed
-
Real-Time Multilingual Sign Language Processing2 Dec 2024 0 repositories listed
-
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model26 Nov 2024 0 repositories listed
-
Signs as Tokens: An Autoregressive Multilingual Sign Language Generator26 Nov 2024 0 repositories listed
-
Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation25 Nov 2024 0 repositories listed
-
SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction25 Nov 2024 0 repositories listed
-
Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs19 Nov 2024 0 repositories listed
-
American Sign Language to Text Translation using Transformer and Seq2Seq with LSTM17 Sep 2024 0 repositories listed
-
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing15 Sep 2024 0 repositories listed
-
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis12 Sep 2024 0 repositories listed
-
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services3 Sep 2024 0 repositories listed
-
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation27 Aug 2024 0 repositories listed
-
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation24 Aug 2024 0 repositories listed
-
C²RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval19 Aug 2024 0 repositories listed
-
Scaling up Multimodal Pre-training for Sign Language Understanding16 Aug 2024 0 repositories listed
-
Fingerspelling within Sign Language Translation13 Aug 2024 0 repositories listed
-
FSboard: Over 3 million characters of ASL fingerspelling collected via smartphones22 Jul 2024 0 repositories listed
-
EvSign: Sign Language Recognition and Translation with Streaming Events17 Jul 2024 0 repositories listed
-
Scaling Sign Language Translation16 Jul 2024 0 repositories listed
-
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production3 Jul 2024 0 repositories listed
-
Reconsidering Sentence-Level Sign Language Translation16 Jun 2024 0 repositories listed
-
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale11 Jun 2024 0 repositories listed
-
Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation7 May 2024 0 repositories listed
-
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods5 May 2024 0 repositories listed
-
Stream State-tying for Sign Language Recognition21 Apr 2024 0 repositories listed
-
LLMs are Good Sign Language Translators1 Apr 2024 0 repositories listed
-
Using an LLM to Turn Sign Spottings into Spoken Language Sentences15 Mar 2024 0 repositories listed
-
Unsupervised Sign Language Translation and Generation12 Feb 2024 0 repositories listed
-
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions10 Jan 2024 0 repositories listed
-
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text15 Dec 2023 0 repositories listed
-
sign.mt: Real-Time Multilingual Sign Language Translation Application8 Oct 2023 0 repositories listed
-
A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset7 Oct 2023 0 repositories listed
-
Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation4 Sep 2023 0 repositories listed
-
23 Aug 2023 0 repositories listed
-
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods23 Aug 2023 0 repositories listed
Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections