Alternatives and similar repositories for mini-vllm

Users that are interested in mini-vllm are comparing it to the libraries listed below

• clabrugere / scratch-llm
  Implements a LLM similar to Meta's Llama 2 from the ground up in PyTorch, for educational purposes.
  ☆38Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 5 years ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• Hemanthkumar2112 / Reward-Modeling-RLHF-Finetune-and-RAG
  Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform
  ☆22Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• kabir2505 / tiny-mixtral
  ☆45Updated 9 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 11 months ago
• kirajano / two_tower_recommenders
  Building Recommender System with the Two-Tower Architecture
  ☆17Updated 4 years ago
• ulab-uiuc / live-trade-bench
  Live evaluation of trading agents
  ☆95Updated 2 months ago
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated 2 weeks ago
• google-deepmind / llms_can_learn_rules
  ☆63Updated last year
• codingfisch / flashrl
  Fast reinforcement learning 💨
  ☆28Updated 6 months ago
• OPPO-PersonalAI / FINDER_DEFT
  Official implementation for paper "How Far Are We from Genuinely Useful Deep Research Agents?"
  ☆63Updated 2 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 9 months ago
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆22Updated 9 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆49Updated last year
• pygongnlp / CoSearchAgent
  [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models
  ☆30Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• JRC1995 / ZeroPromptSearch
  Implementation of an LLM prompting pipeline combined with wrappers for auto-decomposing reasoning steps and for search through the reason…
  ☆15Updated last year
• oashua / MathAgent
  Code repo for MathAgent
  ☆19Updated 2 years ago
• yifanzhang-pro / HLA
  Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)
  ☆44Updated last month
• epfml / llm-optimizer-benchmark
  Benchmarking Optimizers for LLM Pretraining
  ☆49Updated last month
• vibrantlabsai / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆36Updated 2 years ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆79Updated 11 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆111Updated last year
• rajlm10 / D2L-Torch
  Learning PyTorch through the D2L book. A series of notebooks for the same
  ☆28Updated 3 years ago
• liujch1998 / infini-gram
  ☆96Updated 2 weeks ago
• microsoft / REBEL
  ☆42Updated 9 months ago
• LiqiangJing / DSBench
  [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆103Updated 5 months ago