stepfun-ai / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆41Updated last week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Kyutai with an "eye"☆236Updated 10 months ago
- An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.☆87Updated last month
- Service for testing out the new Qwen2.5 omni model☆63Updated 9 months ago
- The official GitHub Page for MiniMax☆62Updated 3 months ago
- Liquid Audio - Speech-to-Speech audio models by Liquid AI☆388Updated 2 weeks ago
- AudioStory: Generating Long-Form Narrative Audio with Large Language Models☆301Updated 4 months ago
- ☆484Updated 9 months ago
- The official Python library for the Fish Audio API.☆139Updated this week
- This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …☆14Updated 6 months ago
- ☆43Updated 10 months ago
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆192Updated last month
- Voxtral: Convert Mistral into a end2end SpeechLM. No information bottleneck, preserves prosody, learns interruptions from data. Unlike GP…☆42Updated 11 months ago
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…☆135Updated 2 months ago
- xllamacpp - a Python wrapper of llama.cpp☆73Updated this week
- AI tool for auto-research, TTS, and Graphical assembly into a completed Podcast☆84Updated 6 months ago
- ☆72Updated 2 months ago
- Tencent Hunyuan 7B (short as Hunyuan-7B) is one of the large language dense models of Tencent Hunyuan☆71Updated 6 months ago
- A highly optimized engine for maya-1 tts model to generate minutes of audio in seconds.☆60Updated 2 months ago
- ☆474Updated 8 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆22Updated last year
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆11Updated 7 months ago
- A powerful 3B-parameter, LLM-based Reinforcement Learning audio edit model excels at editing emotion, speaking style, and paralinguistics…☆862Updated last week
- Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B☆569Updated 2 months ago
- VoiceStar: Robust, Duration-controllable TTS that can Extrapolate☆307Updated 8 months ago
- ☆60Updated last month
- Proof of concept for running moshi/hibiki using webrtc☆20Updated 11 months ago
- Audiobook creation tool with support for multiple TTS models (MiraTTS, GLM-TTS, IndexTTS2, VibeVoice, Higgs V2, Fish S1-mini, Chatterbox,…☆71Updated this week
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆38Updated last year
- Fused Qwen3 MoE layer for faster training, compatible with Transformers, LoRA, bnb 4-bit quant, Unsloth. Also possible to train LoRA over…☆231Updated this week
- ☆251Updated last month