Chen-zexi / vllm-cliLinks
A command-line interface tool for serving LLM using vLLM.
☆456Updated last week
Alternatives and similar repositories for vllm-cli
Users that are interested in vllm-cli are comparing it to the libraries listed below
Sorting:
- ☆421Updated last week
- Verify Precision of all Kimi K2 API Vendor☆461Updated 3 weeks ago
- ☆260Updated last month
- The LLM abstraction layer for modern AI agent applications.☆484Updated this week
- Python Implementation of MUVERA (Multi-Vector Retrieval via Fixed Dimensional Encodings)☆359Updated 5 months ago
- Train embedding and reranker models for retrieval tasks on Apple Silicon with MLX☆168Updated 2 months ago
- Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere☆956Updated this week
- Train Large Language Models on MLX.☆230Updated this week
- ☆153Updated this week
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆211Updated last month
- ☆301Updated 4 months ago
- Model Activity Visualiser☆519Updated 8 months ago
- LettuceDetect is a hallucination detection framework for RAG applications.☆517Updated 3 months ago
- Library for model distillation☆158Updated 3 months ago
- Evolve your language agent with Agentic Context Engineering (ACE)☆136Updated 3 weeks ago
- Completed research on semantic retrieval augmented generation through novel semantic similarity graph traversal algorithms.☆255Updated last month
- Sparse Inferencing for transformer based LLMs☆215Updated 4 months ago
- ☆124Updated last week
- An Automatic Prompt Optimization Framework for Large Language Models☆141Updated 4 months ago
- A flexible, adaptive classification system for dynamic text classification☆510Updated 2 months ago
- Turn topics into essays in seconds!☆190Updated 5 months ago
- ☆334Updated last week
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆450Updated 3 months ago
- ☆2,197Updated last week
- The Open Deep Research app – generate reports with OSS LLMs☆310Updated this week
- ☆171Updated 3 months ago
- ☆158Updated 7 months ago
- 🧍♂️LLM as a manager for approval processes.☆209Updated 7 months ago
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆278Updated 3 months ago
- HawkinsDB is our take on giving AI systems a more human-like way to store and recall information, inspired by how our own brains work. Ba…☆317Updated 11 months ago