Chen-zexi / vllm-cliLinks
A command-line interface tool for serving LLM using vLLM.
☆458Updated 3 weeks ago
Alternatives and similar repositories for vllm-cli
Users that are interested in vllm-cli are comparing it to the libraries listed below
Sorting:
- A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…☆235Updated last week
- ☆261Updated last month
- LLMRouter: An Open-Source Library for LLM Routing☆564Updated this week
- ☆428Updated 3 weeks ago
- The LLM abstraction layer for modern AI agent applications.☆500Updated last week
- ☆301Updated 4 months ago
- Train embedding and reranker models for retrieval tasks on Apple Silicon with MLX☆172Updated 3 months ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆222Updated 2 months ago
- Python Implementation of MUVERA (Multi-Vector Retrieval via Fixed Dimensional Encodings)☆382Updated 3 weeks ago
- Verify Precision of all Kimi K2 API Vendor☆487Updated last month
- Completed research on semantic retrieval augmented generation through novel semantic similarity graph traversal algorithms.☆265Updated last month
- A list of AI memory projects☆567Updated 11 months ago
- Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere☆1,050Updated this week
- Library for model distillation☆158Updated 3 months ago
- 🧍♂️LLM as a manager for approval processes.☆211Updated 8 months ago
- ☆734Updated last week
- Turn topics into essays in seconds!☆190Updated 5 months ago
- LettuceDetect is a hallucination detection framework for RAG applications.☆519Updated 3 months ago
- Evolve your language agent with Agentic Context Engineering (ACE)☆456Updated last month
- Model Activity Visualiser☆519Updated 8 months ago
- AI Agent that researches the lives of historical figures and extracts events into structured JSON timelines using LangGraph multi-agent o…☆218Updated 2 months ago
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆455Updated 4 months ago
- HawkinsDB is our take on giving AI systems a more human-like way to store and recall information, inspired by how our own brains work. Ba…☆319Updated last year
- Train Large Language Models on MLX.☆239Updated 3 weeks ago
- An open-source application for building, observing, and collaborating with teams of AI agents.☆411Updated 4 months ago
- "OpenPhone: Mobile Agentic Foundation Models for AI Phone"☆426Updated 2 weeks ago
- ☆159Updated 8 months ago
- Community maintained hardware plugin for vLLM on Apple Silicon☆139Updated this week
- Real-Time Detection of Hallucinated Entities in Long-Form Generation☆273Updated last month
- ☆174Updated 4 months ago