xiaomi-research / dasheng-lmView external linksLinks
Efficient audio understanding with general audio captions
☆399Nov 3, 2025Updated 3 months ago
Alternatives and similar repositories for dasheng-lm
Users that are interested in dasheng-lm are comparing it to the libraries listed below
Sorting:
- Official PyTorch code for Deep Audio-Signal Holistic Embeddings☆182Nov 7, 2025Updated 3 months ago
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆195Dec 13, 2025Updated 2 months ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆314Mar 28, 2025Updated 10 months ago
- [ICASSP 2026] Task Vector in TTS: Toward Emotionally Expressive Dialectal Speech Synthesis☆36Dec 24, 2025Updated last month
- ☆115Sep 18, 2025Updated 4 months ago
- MiMo-Audio: Audio Language Models are Few-Shot Learners☆968Sep 20, 2025Updated 4 months ago
- Colab notebook for fine-tuning Qwen2-Audio with trl's SFT and PPO trainers.☆24Nov 23, 2024Updated last year
- The open source code for LLM-Codec☆145Aug 18, 2024Updated last year
- OSUM & OSUM-EChat, open speech understanding model and empathetic spoken chatbot based on it, open-sourced by ASLP@NPU.☆480Nov 23, 2025Updated 2 months ago
- We Speech Transcript based on LLM, in 300 lines of code.☆183Jun 20, 2025Updated 7 months ago
- ☆37Jul 4, 2024Updated last year
- Grapheme-to-Phoneme for Mixed Chinese (Mandarin or Cantonese) and English.☆114Dec 2, 2025Updated 2 months ago
- Ultra-low bitrate neural audio codec (0.31~1.40 kbps) with a better semantic in the latent space.☆245Mar 7, 2025Updated 11 months ago
- ☆114Oct 21, 2025Updated 3 months ago
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆972Jan 15, 2026Updated last month
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆331Jan 29, 2026Updated 2 weeks ago
- Python runtime for WeTextProcessing (does not depend on Pynini)☆48Nov 28, 2025Updated 2 months ago
- A native-PyTorch library for large scale M-LLM (text/audio) training with tp/cp/dp.☆224Aug 6, 2025Updated 6 months ago
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆217Feb 28, 2025Updated 11 months ago
- Audio-FLAN☆160Sep 23, 2025Updated 4 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆181Feb 4, 2026Updated last week
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Survey".☆208Feb 10, 2026Updated last week
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆142Nov 30, 2025Updated 2 months ago
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆505Dec 22, 2025Updated last month
- ☆22Jan 29, 2026Updated 2 weeks ago
- [EMNLP 2025 Findings] A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E…☆27Jul 11, 2025Updated 7 months ago
- Code from blog 'Searching by Music: Leveraging Vector Search for Music Information Retrieval'☆16Nov 16, 2023Updated 2 years ago
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆179Feb 3, 2026Updated 2 weeks ago
- E2E TTS using Conditional Flow Matching (Experimental*)☆71Nov 10, 2023Updated 2 years ago
- Text-To-Speech for NotebookLM☆37Jul 20, 2025Updated 6 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆96Nov 9, 2024Updated last year
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆195Dec 13, 2024Updated last year
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆37Jan 15, 2026Updated last month
- Step-Audio 2 is an end-to-end multi-modal large language model designed for industry-strength audio understanding and speech conversation…☆1,336Sep 22, 2025Updated 4 months ago
- Official Implementation of GLAP - General Language Audio Pretraining☆61Jan 5, 2026Updated last month
- [ACMMM'2024] Generative Expressive Conversational Speech Synthesis☆44Oct 28, 2024Updated last year
- Real-time Speech-Text Foundation Model Toolkit (wip)☆252Mar 26, 2025Updated 10 months ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆646Jun 9, 2024Updated last year
- ☆161Nov 20, 2025Updated 2 months ago