sequence models: 16 curated resources
sequence models
16 resources · page 1 of 1
FunASR
by ModelScope
ModelScope FunASR GitHub repo: speech recognition toolkit for training, inference and streaming ASR.
AssemblyAI engineering blog
by AssemblyAI
AssemblyAI blog with guides, model launches and voice-agent builds for speech AI.
Karpathy: Unreasonable Effectiveness of RNNs
by Andrej
Andrej Karpathy's 2015 essay The Unreasonable Effectiveness of Recurrent Neural Networks, with char-RNN examples.
Recurrent Neural Networks and LSTM (Jürgen Schmidhuber)
Jürgen Schmidhuber's IDSIA page on recurrent neural networks and LSTM, with history and references.
Soniox Docs: Models
by Soniox
Soniox models page listing speech-to-text model versions, changelog and deprecations.
Speechmatics technical articles
by Speechmatics
Speechmatics articles on speech recognition technology, product news and AI research.
Zoom Scribe API documentation
by Zoom
Zoom Scribe API documentation: transcription service for many media formats, with modes and authentication details.
ESPnet
by ESPnet
ESPnet documentation: end-to-end speech processing toolkit with recipes for recognition, synthesis and translation.
GRU
by Kyunghyun Cho et al. (Université de Montréal)
arXiv paper (2014) introducing the RNN encoder–decoder with gated recurrent units (GRU) for machine translation.
GRU empirical evaluation
by Junyoung Chung et al. (Université de Montréal)
arXiv paper (2014) empirically comparing gated recurrent units (GRU) and LSTM on sequence modelling.
Montreal Forced Aligner
by Montreal Forced Aligner project (McGill University)
Montreal Forced Aligner documentation: tool for aligning speech audio with transcripts and training pronunciation models.
RWKV
by Bo Peng et al. (University of British Columbia)
arXiv paper (2023) introducing RWKV, a recurrent architecture trained in parallel like a transformer.
Efficiently Modeling Long Sequences with Structured State Spaces (S4)
by Albert Gu et al. (Stanford University)
arXiv paper (2021) "Efficiently Modeling Long Sequences with Structured State Spaces", introducing S4, structured state space models for long sequences.
WaveNet
by Aaron van den Oord et al. (DeepMind)
arXiv paper (2016) "WaveNet: A Generative Model for Raw Audio", introducing WaveNet, an autoregressive generative model of raw audio.
xLSTM (NXAI, Linz)
by Maximilian Beck et al. (NXAI)
arXiv paper (2024) introducing xLSTM, extended long short-term memory with exponential gating and matrix memory.
Mamba
by Albert Gu and Tri Dao (Carnegie Mellon University)
arXiv paper (2023) introducing Mamba, linear-time sequence modelling with selective state spaces.