Alternatives and similar repositories for vllm-benchmark:

Users that are interested in vllm-benchmark are comparing it to the libraries listed below

• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆86Updated 10 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• ianhohoho / auto-hyde
  🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…
  ☆32Updated 11 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 7 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆80Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆80Updated last week
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆83Updated last month
• cognitivecomputations / spectrum
  ☆113Updated 5 months ago
• bentoml / llm-bench
  ☆48Updated 3 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆63Updated 11 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 11 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 4 months ago
• nyunAI / PruneGPT
  ☆53Updated 9 months ago
• triton-inference-server / vllm_backend
  ☆235Updated this week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆58Updated 6 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆64Updated 8 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 2 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• InternLM / SWE-Fixer
  ☆77Updated 2 weeks ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆208Updated this week
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆116Updated last year
• plaggy / rag-containers
  Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.
  ☆59Updated 2 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆204Updated 4 months ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 4 months ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆103Updated 10 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆101Updated 2 months ago
• microsoft / batch-inference
  Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
  ☆94Updated 6 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 2 months ago
• dsdanielpark / open-llm-datasets
  Repository for organizing datasets and papers used in Open LLM.
  ☆93Updated last year
• vllm-project / dashboard
  vLLM performance dashboard
  ☆23Updated 10 months ago