Chen-zexi / vllm-cliLinks
A command-line interface tool for serving LLM using vLLM.
☆418Updated last month
Alternatives and similar repositories for vllm-cli
Users that are interested in vllm-cli are comparing it to the libraries listed below
Sorting:
- ☆300Updated 2 months ago
- ☆77Updated this week
- frozen-in-time version of our Paper Finder agent for reproducing evaluation results☆187Updated last month
- Model Activity Visualiser☆518Updated 5 months ago
- Train embedding and reranker models for retrieval tasks on Apple Silicon with MLX☆158Updated 2 weeks ago
- Python Implementation of MUVERA (Multi-Vector Retrieval via Fixed Dimensional Encodings)☆321Updated 3 months ago
- ☆232Updated 3 months ago
- LettuceDetect is a hallucination detection framework for RAG applications.☆504Updated 3 weeks ago
- The Open Deep Research app – generate reports with OSS LLMs☆300Updated 2 months ago
- An open-source application for building, observing, and collaborating with teams of AI agents.☆391Updated last month
- All-in-One Sandbox for AI Agents that combines Browser, Shell, File, MCP and VSCode Server in a single Docker container.☆462Updated last week
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆441Updated last month
- 🧍♂️LLM as a manager for approval processes.☆208Updated 5 months ago
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆279Updated last month
- Turn topics into essays in seconds!☆187Updated 3 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆122Updated 2 months ago
- Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.☆573Updated 2 weeks ago
- ☆388Updated this week
- Library for model distillation☆153Updated last month
- HawkinsDB is our take on giving AI systems a more human-like way to store and recall information, inspired by how our own brains work. Ba…☆310Updated 9 months ago
- It takes a village to raise a child: Google DeepThink 🧠 but in LangGraph and free - an original algorithm for collaborative agents using…☆127Updated 2 weeks ago
- ☆1,273Updated last week
- ☆567Updated 3 months ago
- Anemoi: A Semi-Centralized Multi-agent Systems Based on Agent-to-Agent Communication MCP server from Coral Protocol☆367Updated last month
- Verifiers for LLM Reinforcement Learning☆75Updated 3 weeks ago
- ☆145Updated 2 months ago
- Seed-Coder is a family of lightweight open-source code LLMs comprising base, instruct and reasoning models, developed by ByteDance Seed.☆552Updated 4 months ago
- Model-agnostic plug-n-play LangChain/LangGraph agents powered entirely by MCP tools over HTTP/SSE.☆610Updated 3 weeks ago
- A Tree Search Library with Flexible API for LLM Inference-Time Scaling☆475Updated 2 months ago
- II-Researcher: a new open-source framework designed to aid building search / research agents☆474Updated 2 months ago