Alternatives and similar repositories for vllm-benchmark

Users that are interested in vllm-benchmark are comparing it to the libraries listed below

• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆67Updated last year
• triton-inference-server / vllm_backend
  ☆260Updated 2 weeks ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆75Updated 2 weeks ago
• nyunAI / PruneGPT
  ☆53Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 10 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆57Updated last month
• AlexBodner / How_Much_VRAM
  ☆101Updated 9 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆127Updated last month
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆67Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆114Updated this week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆61Updated 9 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆90Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆220Updated 7 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 10 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆76Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆88Updated 3 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 11 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆23Updated 3 months ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 10 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆70Updated 7 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 7 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆317Updated this week
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 6 months ago
• bentoml / llm-bench
  ☆52Updated 6 months ago
• cognitivecomputations / OpenChatML
  ☆157Updated 10 months ago
• LLM-inference-router / vllm-router
  vLLM Router
  ☆28Updated last year
• cognitivecomputations / spectrum
  ☆121Updated last month
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆148Updated 4 months ago