ictnlp / LLaMA-Omni
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
☆2,571Updated last week
Related projects ⓘ
Alternatives and complementary repositories for LLaMA-Omni
- A fast multimodal LLM for real-time voice☆1,339Updated this week
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,092Updated 2 weeks ago
- ☆6,781Updated 3 weeks ago
- first base model for full-duplex conversational audio☆1,560Updated last week
- Local realtime voice AI☆1,946Updated this week
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆781Updated 3 weeks ago
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,155Updated 2 weeks ago
- Fast and accurate automatic speech recognition (ASR) for edge devices☆2,183Updated this week
- WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.☆1,547Updated 3 months ago
- Empowering RAG with a memory-based data interface for all-purpose applications!☆1,220Updated last week
- Whisper with Medusa heads☆799Updated 2 weeks ago
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆3,540Updated 2 weeks ago
- LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs☆1,499Updated 3 weeks ago
- Local SRT/LLM/TTS Voicechat☆544Updated last month
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆3,906Updated last month
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,230Updated 3 months ago
- Janus-Series: Unified Multimodal Understanding and Generation Models☆1,084Updated last week
- Open Source framework for voice and multimodal conversational AI☆3,385Updated this week
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,565Updated 2 weeks ago
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,490Updated 4 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!☆3,256Updated 3 months ago
- Optimizing inference proxy for LLMs☆1,563Updated this week
- The Open Cookbook for Top-Tier Code Large Language Model☆1,182Updated this week
- GLM-4-Voice | 端到端中英语音对话模型☆2,289Updated last week
- ☆2,746Updated 2 months ago
- Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.☆3,615Updated 3 weeks ago
- An Open Source text-to-speech system built by inverting Whisper.☆3,982Updated 5 months ago
- Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit☆718Updated 3 months ago
- This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open sourced AI models developed by Microsoft. Phi-3 models are t…☆2,487Updated last week
- Inference and training library for high-quality TTS models.☆4,658Updated 3 weeks ago