Alternatives and similar repositories for vllm-cli

Users that are interested in vllm-cli are comparing it to the libraries listed below

• MoonshotAI / kosong
  The LLM abstraction layer for modern AI agent applications.
  ☆376Updated last week
• leoheuler / flashtensors
  ☆365Updated this week
• GradientHQ / parallax
  Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
  ☆681Updated this week
• Doriandarko / MLX-GRPO
  A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
  ☆204Updated 3 weeks ago
• sionic-ai / muvera-py
  Python Implementation of MUVERA (Multi-Vector Retrieval via Fixed Dimensional Encodings)
  ☆351Updated 4 months ago
• agentica-org / pepper
  ☆252Updated last week
• attentionmech / mav
  Model Activity Visualiser
  ☆519Updated 7 months ago
• MetaStone-AI / XBai-o4
  ☆300Updated 3 months ago
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆378Updated 3 weeks ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆156Updated 2 months ago
• jina-ai / mlx-retrieval
  Train embedding and reranker models for retrieval tasks on Apple Silicon with MLX
  ☆167Updated 2 months ago
• KRLabsOrg / LettuceDetect
  LettuceDetect is a hallucination detection framework for RAG applications.
  ☆510Updated 2 months ago
• AstraBert / llama-4-researcher
  Turn topics into essays in seconds!
  ☆191Updated 4 months ago
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆449Updated 2 months ago
• Intelligent-Internet / CommonGround
  An open-source application for building, observing, and collaborating with teams of AI agents.
  ☆399Updated 3 months ago
• allenai / asta-paper-finder
  frozen-in-time version of our Paper Finder agent for reproducing evaluation results
  ☆205Updated 2 months ago
• Vaibhavs10 / mcp-with-openai-gpt-oss
  ☆138Updated 3 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆216Updated this week
• harishsg993010 / HawkinsDB
  HawkinsDB is our take on giving AI systems a more human-like way to store and recall information, inspired by how our own brains work. Ba…
  ☆314Updated 10 months ago
• janhq / verifiers-deepresearch
  Verifiers for LLM Reinforcement Learning
  ☆78Updated 2 months ago
• langchain-ai / llmanager
  🧍‍♂️LLM as a manager for approval processes.
  ☆209Updated 7 months ago
• Bogdanovich77 / DeekSeek-OCR---Dockerized-API
  ☆1,012Updated 3 weeks ago
• google / lmeval
  ☆235Updated 4 months ago
• google-ai-edge / LiteRT-LM
  ☆477Updated this week
• NVlabs / Jet-Nemotron
  ☆702Updated last month
• langchain-ai / multi-modal-researcher
  ☆579Updated 4 months ago
• harishsg993010 / LLM-Reasoner
  Make any LLM to think like OpenAI o1 and deepseek R1
  ☆492Updated 9 months ago
• Nutlope / open-deep-research
  The Open Deep Research app – generate reports with OSS LLMs
  ☆304Updated last week
• janhq / ReZero
  ☆158Updated 7 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆208Updated 3 months ago