ictnlp / LLaMA-Omni2Links
☆228Updated 3 months ago
Alternatives and similar repositories for LLaMA-Omni2
Users that are interested in LLaMA-Omni2 are comparing it to the libraries listed below
Sorting:
- LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM☆273Updated 4 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆245Updated 5 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆281Updated 3 weeks ago
- ☆294Updated 2 months ago
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…☆218Updated 3 months ago
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆153Updated last month
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆75Updated 2 months ago
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆298Updated last month
- Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation☆179Updated last month
- Collection of Open Source Speech Data☆160Updated 10 months ago
- ☆278Updated last month
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,…☆78Updated 11 months ago
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆83Updated 2 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆254Updated 2 months ago
- ☆310Updated 5 months ago
- Text-audio foundation model from Boson AI☆99Updated last week
- 🎙️ Automatically transcribe audio/video into high-quality, speaker-specific Text-To-Speech datasets ✨☆123Updated last month
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆207Updated 6 months ago
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆47Updated 3 months ago
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆117Updated 3 months ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆122Updated last month
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆140Updated last month
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆75Updated 10 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆341Updated 3 months ago
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆170Updated this week
- LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆613Updated 5 months ago
- ☆140Updated 3 weeks ago
- Finetune Sesame AI's conversational speech model on new languages and voices. Blog post: https://blog.speechmatics.com/sesame-finetune☆72Updated 3 months ago
- ☆108Updated last week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆116Updated 9 months ago