Alternatives and similar repositories for vllm:

Users that are interested in vllm are comparing it to the libraries listed below

• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 months ago
• i-am-bee / beeai-code-interpreter
  An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.
  ☆56Updated this week
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆38Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆82Updated 3 weeks ago
• IBM / unitxt
  🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
  ☆181Updated this week
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆46Updated this week
• Just-Curieous / Curie
  ❓Curie: Automated and Rigorous Scientific Experimentation with AI Agents
  ☆54Updated this week
• instructlab / training
  InstructLab Training Library - Efficient Fine-Tuning with Message-Format Data
  ☆30Updated this week
• foundation-model-stack / fms-extras
  ☆24Updated 6 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆111Updated 9 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 4 months ago
• i-am-bee / bee-observe
  Observability API server for bee-agent-framework
  ☆13Updated last week
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 3 months ago
• multi-agent-systems-failure-taxonomy / MASFT
  ☆78Updated last week
• LLMSELECTOR / LLMSELECTOR
  ☆61Updated last month
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆55Updated this week
• ScalingIntelligence / codemonkeys
  ☆36Updated 2 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆139Updated 3 weeks ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆85Updated 2 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆52Updated this week
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 4 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• nicknochnack / beeagent
  ☆11Updated 6 months ago
• i-am-bee / bee-proto
  Protobuf interface and stubs for Bee Agent Framework.
  ☆11Updated last week
• cornstarch-org / Cornstarch
  ☆64Updated this week
• run-ai / runai-model-streamer
  ☆174Updated this week
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆21Updated 2 months ago
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆29Updated 6 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 6 months ago
• microsoft / agdebugger
  ☆30Updated 3 weeks ago