skit-ai / SpeechLLM
This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingface.
☆61Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for SpeechLLM
- AudioBench: A Universal Benchmark for Audio Large Language Models☆93Updated last week
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆160Updated 4 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆48Updated 5 months ago
- The open source code for LLM-Codec☆114Updated 3 months ago
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆72Updated 5 months ago
- Clustering-based methods for overlapping diarization☆70Updated 10 months ago
- AutoPrep: An Automatic Preprocessing Framework for In-the-Wild Speech Data☆29Updated 10 months ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆81Updated last week
- Reference-aware automatic speech evaluation toolkit☆109Updated 9 months ago
- ConMamba for Automatic Speech Recognition☆44Updated 3 months ago
- High fidelity, lightweight, end-to-end, streaming, convolution-based neural audio codec☆80Updated last month
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆109Updated last week
- multilingual speech aligner☆72Updated last year
- Speaker change detection using SincNet and an LSTM/Transformer☆44Updated 4 months ago
- An unofficial PyTorch implementation of Mix-Phoneme-Bert☆39Updated last year
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆118Updated 3 weeks ago
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆126Updated 8 months ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆44Updated last year
- Real-time Speech-Text Foundation Model Toolkit (wip)☆122Updated last month
- ☆57Updated 2 months ago
- ☆47Updated 2 weeks ago
- Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning (ASRU2023)☆26Updated last year
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆74Updated last year
- ☆59Updated 2 months ago
- Code for paper A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing☆85Updated 2 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆56Updated 3 months ago
- ☆49Updated 9 months ago
- All generative model in one for better TTS model☆66Updated 2 months ago