Alternatives and similar repositories for llmperf-leaderboard

Users that are interested in llmperf-leaderboard are comparing it to the libraries listed below

• apoorvumang / prompt-lookup-decoding
  ☆561Updated last year
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆1,083Updated last year
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆229Updated 8 months ago
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,263Updated 5 months ago
• Snowflake-Labs / snowflake-arctic
  ☆546Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆224Updated last year
• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆996Updated 8 months ago
• scaleapi / llm-engine
  Scale LLM Engine public repository
  ☆809Updated last week
• nexusflowai / NexusRaven
  NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…
  ☆316Updated last year
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆310Updated last week
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆424Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆710Updated last year
• sabetAI / BLoRA
  batched loras
  ☆345Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆461Updated last month
• mistralai-sf24 / hackathon
  ☆446Updated last year
• philschmid / easyllm
  ☆460Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆655Updated last year
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆80Updated this week
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆188Updated last year
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated 10 months ago
• triton-inference-server / vllm_backend
  ☆291Updated 3 weeks ago
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆594Updated last year
• run-ai / llmperf
  ☆58Updated 11 months ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆548Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆94Updated 4 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 5 months ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆617Updated 3 months ago
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆661Updated last year