skit-ai / SpeechLLM
This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingface.
☆84Updated 7 months ago
Alternatives and similar repositories for SpeechLLM:
Users that are interested in SpeechLLM are comparing it to the libraries listed below
- Update ASR paper everyday☆131Updated this week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆109Updated 2 months ago
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆140Updated last month
- AudioBench: A Universal Benchmark for Audio Large Language Models☆124Updated 3 weeks ago
- Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context☆189Updated 5 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆168Updated 7 months ago
- Official release of StyleTalk dataset.☆61Updated 7 months ago
- Reference-aware automatic speech evaluation toolkit☆142Updated 2 months ago
- ConMamba for Automatic Speech Recognition☆57Updated 6 months ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆85Updated 3 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆128Updated 4 months ago
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆50Updated last month
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆143Updated 11 months ago
- The open source code for LLM-Codec☆126Updated 6 months ago
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆75Updated 8 months ago
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆132Updated 5 months ago
- Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)☆27Updated last year
- a curated list of speech datasets (110+ datasets, 75+ easy to download)☆122Updated 2 years ago
- wav2vec2 audio classification for prosodic boundary detection and other tasks☆38Updated last year
- This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.☆107Updated last year
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- UTokyo-SaruLab MOS Prediction System☆147Updated 2 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆119Updated last month
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆111Updated last year
- ☆71Updated last year
- Code for our INTERSPEECH paper Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection☆57Updated this week
- Target Speaker Extraction Toolkit☆144Updated 2 weeks ago
- Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.☆70Updated last year
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆204Updated last year