Sign Language Translation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

17 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 56 papers with code (153 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation
  8 Mar 2022 4 repositories listed Syntology ran 5 of 10 samples · 5 unverified · 9 pointer-only (licence)
  Concretely, we pretrain the sign-to-gloss visual network on the general domain of human actions and the within-domain of a sign-to-gloss dataset, and pretrain the gloss-to-text translation network on the general domain…
• Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison
  24 Oct 2019 3 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  Based on this new large-scale dataset, we are able to experiment with several deep learning methods for word-level sign recognition and evaluate their performances in large scale scenarios.
• SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models
  20 Sep 2023 2 repositories listed
  We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system.
• An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation
  28 May 2023 2 repositories listed
  Sign language translation systems are complex and require many components.
• TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation
  12 Oct 2020 2 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 3 pointer-only (licence)
  Sign language translation (SLT) aims to interpret sign video sequences into text-based natural language sentences.
• Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation
  30 Mar 2020 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  We report state-of-the-art sign language recognition and translation results achieved by our Sign Language Transformers.
• Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Model
  30 May 2025 1 repository listed
  Sign Language Translation (SLT) aims to convert sign language (SL) videos into spoken language text, thereby bridging the communication gap between the sign and the spoken community.
• Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation
  30 May 2025 1 repository listed Syntology ran 6 of 7 samples · 1 unverified · 7 pointer-only (licence)
  This work demonstrates the potential of hyperbolic geometry to improve skeletal representations for Sign Language Translation, improving on SOTA RGB methods while preserving privacy and improving computational…
• Sign Language Translation using Frame and Event Stream: Benchmark Dataset and Algorithms
  9 Mar 2025 1 repository listed
  Accurate sign language understanding serves as a crucial communication channel for individuals with disabilities.
• Uni-Sign: Toward Unified Sign Language Understanding at Scale
  25 Jan 2025 1 repository listed Syntology ran 14 of 15 samples · 1 unverified · 15 pointer-only (licence)
  Sign language pre-training has gained increasing attention for its ability to enhance performance across various sign language understanding (SLU) tasks.
• Real-time Bangla Sign Language Translator
  21 Dec 2024 1 repository listed
  The human body communicates through various meaningful gestures, with sign language using hands being a prominent example.
• Improvement in Sign Language Translation Using Text CTC Alignment
  12 Dec 2024 1 repository listed
  In this work, we propose a novel method combining joint CTC/Attention and transfer learning.
• Signformer is all you need: Towards Edge AI for Sign Language
  19 Nov 2024 1 repository listed
  Sign language translation, especially in gloss-free paradigm, is confronting a dilemma of impracticality and unsustainability due to growing resource-intensive methodologies.
• Diverse Sign Language Translation
  25 Oct 2024 1 repository listed
  In this work, we introduce a Diverse Sign Language Translation (DivSLT) task, aiming to generate diverse yet accurate translations for sign language videos.
• SignAttention: On the Interpretability of Transformer Models for Sign Language Translation
  18 Oct 2024 1 repository listed Syntology ran 0 of 3 samples · 3 unverified · 3 pointer-only (licence)
  This paper presents the first comprehensive interpretability analysis of a Transformer-based Sign Language Translation (SLT) model, focusing on the translation from video-based Greek Sign Language to glosses and text.
• Sign Language Sense Disambiguation
  13 Sep 2024 1 repository listed
  This project explores methods to enhance sign language translation of German sign language, specifically focusing on disambiguation of homonyms.
• Less is more: concatenating videos for Sign Language Translation from a small set of signs
  3 Sep 2024 1 repository listed
  The limited amount of labeled data for training the Brazilian Sign Language (Libras) to Portuguese Translation models is a challenging problem due to video collection and annotation costs.
• Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New Algorithm
  20 Aug 2024 1 repository listed
  Based on this dataset and several other large-scale datasets, we propose a novel baseline method that fully leverages the Mamba model's ability to integrate temporal information of CNN features, resulting in improved…
• An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMs
  20 Aug 2024 1 repository listed
  With this in mind, we introduce Spatial and Motion-based Sign Language Translation (SpaMo), a novel LLM-based SLT framework.
• An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface
  17 Aug 2024 1 repository listed
  This paper introduces an open-source interface for American Sign Language fingerspell recognition and semantic pose retrieval, aimed to serve as a stepping stone towards more advanced sign language translation systems.
• Sign Language Translation with Sentence Embedding Supervision
  14 Aug 2024 1 repository listed
  State-of-the-art sign language translation (SLT) systems facilitate the learning process through gloss annotations, either in an end2end manner or by involving an intermediate step.
• Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing
  1 Jul 2024 1 repository listed
  Sign language translation from video to spoken text presents unique challenges owing to the distinct grammar, expression nuances, and high variation of visual appearance across different speakers and contexts.
• SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation
  10 Jun 2024 1 repository listed
  Sign languages are multi-channel languages that communicate information through not just the hands (manual signals) but also facial expressions and upper body movements (non-manual signals).
• Improving Gloss-free Sign Language Translation by Reducing Representation Density
  23 May 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  In this paper, we identify a representation density problem that could be a bottleneck in restricting the performance of gloss-free SLT.
• Multi-Stream Keypoint Attention Network for Sign Language Recognition and Translation
  9 May 2024 1 repository listed
  The resulting framework is denoted as MSKA-SLR, which is expanded into a sign language translation (SLT) model through the straightforward addition of an extra translation network.
• CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation
  17 Apr 2024 1 repository listed
  In specific, CorrNet+ employs a correlation module and an identification module to build human body trajectories.
• Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation
  19 Mar 2024 1 repository listed
  Although some approaches work towards gloss-free SLT through jointly training the visual encoder and translation network, these efforts still suffer from poor performance and inefficient use of the powerful Large…
• Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research through an Extensive Video-Text Corpus
  29 Feb 2024 1 repository listed
  We introduce Mediapi-RGB, a new dataset of French Sign Language (LSF) along with the first LSF-to-French machine translation model.
• Towards Privacy-Aware Sign Language Translation at Scale
  14 Feb 2024 1 repository listed Syntology ran 6 of 12 samples · 6 unverified · 12 pointer-only (licence)
  A major impediment to the advancement of sign language translation (SLT) is data scarcity.
• A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
  9 Jan 2024 1 repository listed
  The objective of this paper is to develop a functional system for translating spoken languages into sign languages, referred to as Spoken2Sign translation.

Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.