Alternatives and similar repositories for mini-vllm

Users that are interested in mini-vllm are comparing it to the libraries listed below

• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 5 years ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 9 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• clabrugere / scratch-llm
  Implements a LLM similar to Meta's Llama 2 from the ground up in PyTorch, for educational purposes.
  ☆38Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• kailums / flash-attention-rocm
  Fast and memory-efficient exact attention ported to rocm
  ☆13Updated 2 years ago
• kabir2505 / tiny-mixtral
  ☆45Updated 9 months ago
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year
• rajlm10 / D2L-Torch
  Learning PyTorch through the D2L book. A series of notebooks for the same
  ☆28Updated 3 years ago
• ulab-uiuc / live-trade-bench
  Live evaluation of trading agents
  ☆95Updated 2 months ago
• Hemanthkumar2112 / Reward-Modeling-RLHF-Finetune-and-RAG
  Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform
  ☆22Updated last year
• prob140 / textbook
  UC Berkeley Data 140 Textbook
  ☆29Updated last month
• inclusionAI / linghe
  A high-performance kernel library for LLM training
  ☆59Updated 2 weeks ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆89Updated this week
• liujch1998 / infini-gram
  ☆97Updated 2 weeks ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆111Updated last year
• basetenlabs / SGLang-Workshop
  Workshop materials for AI Engineer World's Fair
  ☆13Updated 8 months ago
• hao-ai-lab / LookaheadReasoning
  [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning
  ☆65Updated 3 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆83Updated 11 months ago
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated this week
• gnovack / distributed-training-and-deepspeed
  ☆17Updated 2 years ago
• kirajano / two_tower_recommenders
  Building Recommender System with the Two-Tower Architecture
  ☆17Updated 4 years ago
• sail-sg / VocabularyParallelism
  Vocabulary Parallelism
  ☆25Updated 11 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆148Updated last year
• epfml / llm-optimizer-benchmark
  Benchmarking Optimizers for LLM Pretraining
  ☆49Updated last month
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆49Updated last year
• vibrantlabsai / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆36Updated 2 years ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆67Updated last year