Chen-zexi / vllm-cliLinks
A command-line interface tool for serving LLM using vLLM.
☆194Updated this week
Alternatives and similar repositories for vllm-cli
Users that are interested in vllm-cli are comparing it to the libraries listed below
Sorting:
- 🧍♂️LLM as a manager for approval processes.☆206Updated 4 months ago
- Python Implementation of MUVERA (Multi-Vector Retrieval via Fixed Dimensional Encodings)☆291Updated last month
- Model Activity Visualiser☆518Updated 4 months ago
- Turn topics into essays in seconds!☆187Updated last month
- Library for model distillation☆150Updated 6 months ago
- LettuceDetect is a hallucination detection framework for RAG applications.☆477Updated 3 months ago
- RAGLight is a modular framework for Retrieval-Augmented Generation (RAG). It makes it easy to plug in different LLMs, embeddings, and vec…☆286Updated this week
- ☆290Updated 2 weeks ago
- The Open Deep Research app – generate reports with OSS LLMs☆287Updated last month
- ☆228Updated last month
- ☆553Updated last month
- HawkinsDB is our take on giving AI systems a more human-like way to store and recall information, inspired by how our own brains work. Ba…☆304Updated 7 months ago
- ☆208Updated 6 months ago
- ☆132Updated last month
- Turn local files into a prompt for an LLM☆176Updated 7 months ago
- An open-source application for building, observing, and collaborating with teams of AI agents.☆374Updated last week
- ☆243Updated last month
- ☆180Updated 6 months ago
- Googles NotebookLM but local☆361Updated 4 months ago
- ☆186Updated last week
- An opensource implementation of NotebookLM using Deepseek-V3 and PlayHT TTS.☆280Updated 7 months ago
- ☆306Updated this week
- https://no-ocr.com/about☆164Updated last month
- ☆115Updated last week
- Inference, Fine Tuning and many more recipes with Gemma family of models☆266Updated last month
- Official python implementation of the UTCP☆440Updated this week
- 📰 Building News Agents to Summarize News with MCP, Q, and tmux☆298Updated last month
- Local debugging agent that runs in your terminal☆391Updated 2 months ago
- ☆258Updated 3 months ago
- ☆35Updated this week