Speech-to-Text

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 129 papers with code (403 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learning
  21 Sep 2016 8 repositories listed Syntology ran 0 of 10 samples · 10 unverified
  Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments.
• Clotho: An Audio Captioning Dataset
  21 Oct 2019 7 repositories listed Syntology ran 6 of 21 samples · 15 unverified
  Audio captioning is the novel task of general audio content description using free text.
• fairseq S2T: Fast Speech-to-Text Modeling with fairseq
  11 Oct 2020 5 repositories listed
  We introduce fairseq S2T, a fairseq extension for speech-to-text (S2T) modeling tasks such as end-to-end speech recognition and speech-to-text translation.
• SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
  22 Aug 2023 4 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  What does it take to create the Babel Fish, a tool that can help individuals translate speech between any two languages?
• Tools and resources for Romanian text-to-speech and speech-to-text applications
  15 Feb 2018 4 repositories listed
  In this paper we introduce a set of resources and tools aimed at providing support for natural language processing, text-to-speech synthesis and speech recognition for Romanian.
• Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions
  13 Feb 2018 4 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  Deep learning models with convolutional and recurrent networks are now ubiquitous and analyze massive amounts of audio, image, video, text and graph data, with applications in automatic translation, speech-to-text,…
• Audio Adversarial Examples: Targeted Attacks on Speech-to-Text
  5 Jan 2018 4 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  We construct targeted audio adversarial examples on automatic speech recognition.
• Scribosermo: Fast Speech-to-Text models for German and other Languages
  15 Oct 2021 3 repositories listed
  Recent Speech-to-Text models often require a large amount of hardware resources and are mostly trained in English.
• One TTS Alignment To Rule Them All
  23 Aug 2021 3 repositories listed
  However, these alignments tend to be brittle and often fail to generalize to long utterances and out-of-domain text, leading to missing or repeating words.
• Deep Reinforcement Learning For Sequence to Sequence Models
  24 May 2018 3 repositories listed Syntology ran 3 of 17 samples · 14 unverified
  In this survey, we consider seq2seq problems from the RL point of view and provide a formulation combining the power of RL methods in decision-making with sequence-to-sequence models that enable remembering long-term…
• LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT
  7 Oct 2023 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Previous mainstream audio-and-text LLMs use discrete audio tokens to represent both input and output audio; however, they suffer from performance degradation on tasks such as automatic speech recognition, speech-to-text…
• SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
  7 Oct 2022 2 repositories listed
  The rapid development of single-modal pre-training has prompted researchers to pay more attention to cross-modal pre-training methods.
• Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models
  29 Jun 2022 2 repositories listed
  In Spoken Language Understanding (SLU) the task is to extract important information from audio commands, like the intent of what a user wants the system to do and special entities like locations or numbers.
• PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit
  20 May 2022 2 repositories listed
  PaddleSpeech is an open-source all-in-one speech toolkit.
• A³T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing
  18 Mar 2022 2 repositories listed Syntology ran 0 of 7 samples · 7 unverified
  Recently, speech representation learning has improved many speech-related tasks such as speech recognition, speech classification, and speech-to-text translation.
• Learning Shared Semantic Space for Speech-to-Text Translation
  7 May 2021 2 repositories listed Syntology ran 0 of 7 samples · 7 unverified · 7 pointer-only (licence)
  By projecting audio and text features to a common semantic representation, Chimera unifies MT and ST tasks and boosts the performance on ST benchmarks, MuST-C and Augmented Librispeech, to a new state-of-the-art.
• CoVoST 2 and Massively Multilingual Speech-to-Text Translation
  20 Jul 2020 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Speech translation has recently become an increasingly popular topic of research, partly due to the development of benchmark datasets.
• Common Voice: A Massively-Multilingual Speech Corpus
  13 Dec 2019 2 repositories listed
  To our knowledge this is the largest audio corpus in the public domain for speech recognition, both in terms of number of hours and number of languages.
• Speech Model Pre-training for End-to-End Spoken Language Understanding
  7 Apr 2019 2 repositories listed
  Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model.
• The Warmup Dilemma: How Learning Rate Strategies Impact Speech-to-Text Model Convergence
  29 May 2025 1 repository listed
  Training large-scale models presents challenges not only in terms of resource requirements but also in terms of their convergence.
• BeaverTalk: Oregon State University's IWSLT 2025 Simultaneous Speech Translation System
  29 May 2025 1 repository listed
  In particular, on the English→German task, the system achieves a BLEU of 24.
• Audio Jailbreak Attacks: Exposing Vulnerabilities in SpeechGPT in a White-Box Framework
  24 May 2025 1 repository listed
  Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced the naturalness and flexibility of human computer interaction by enabling seamless understanding across text, vision, and audio…
• Enhancing Speech-to-Speech Dialogue Modeling with End-to-End Retrieval-Augmented Generation
  27 Apr 2025 1 repository listed
  In recent years, end-to-end speech-to-speech (S2S) dialogue systems have garnered increasing research attention due to their advantages over traditional cascaded systems, including achieving lower latency and more…
• MEDIBENG WHISPER TINY: A FINE-TUNED CODE-SWITCHED BENGALI-ENGLISH TRANSLATOR FOR CLINICAL APPLICATIONS
  25 Apr 2025 1 repository listed
  The model was fine-tuned on MediBeng, a synthetic dataset created to simulate the types of bilingual interactions often found in healthcare environments.
• Transformer-Based Named Entity Recognition for Automated Server Provisioning
  1 Apr 2025 1 repository listed
  This paper introduces a novel method for automated server provisioning by integrating Transformerbased Named Entity Recognition models with Automated Speech Detection using OpenAI's Whisper.
• Measuring the Effect of Transcription Noise on Downstream Language Understanding Tasks
  19 Feb 2025 1 repository listed
  For instance, we find that task models can tolerate a certain level of noise, and are affected differently by the types of errors in the transcript.
• DuplexMamba: Enhancing Real-time Speech Conversations with Duplex and Streaming Capabilities
  16 Feb 2025 1 repository listed
  In this paper, we propose DuplexMamba, a Mamba-based end-to-end multimodal duplex model for speech-to-text conversation.
• SparQLe: Speech Queries to Text Translation Through LLMs
  13 Feb 2025 1 repository listed
  With the growing influence of Large Language Models (LLMs), there is increasing interest in integrating speech representations with them to enable more seamless multi-modal processing and speech understanding.
• High-Fidelity Simultaneous Speech-To-Speech Translation
  5 Feb 2025 1 repository listed
  To do so, we introduce a weakly-supervised method that leverages the perplexity of an off-the-shelf text translation system to identify optimal delays on a per-word basis and create aligned synthetic data.
• OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia
  23 Jan 2025 1 repository listed
  Large Language Models (LLMs) have made significant progress in various downstream tasks, inspiring the development of Speech Understanding Language Models (SULMs) to enable comprehensive speech-based interactions.

Syntology lines on 10 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.