Alternatives and similar repositories for llmperf-leaderboard

Users that are interested in llmperf-leaderboard are comparing it to the libraries listed below

• apoorvumang / prompt-lookup-decoding
  ☆546Updated 10 months ago
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆1,073Updated last year
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆219Updated 7 months ago
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,258Updated 4 months ago
• scaleapi / llm-engine
  Scale LLM Engine public repository
  ☆808Updated 2 weeks ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆424Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆649Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆216Updated 11 months ago
• sabetAI / BLoRA
  batched loras
  ☆343Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆606Updated 2 months ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆394Updated this week
• Snowflake-Labs / snowflake-arctic
  ☆545Updated 11 months ago
• nexusflowai / NexusRaven
  NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…
  ☆316Updated last year
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆305Updated last month
• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆956Updated 7 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 10 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆701Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆322Updated last year
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆187Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• SkunkworksAI / hydra-moe
  ☆415Updated last year
• triton-inference-server / vllm_backend
  ☆271Updated last month
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated last year
• philschmid / easyllm
  ☆460Updated last year
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆591Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆451Updated last week
• mistralai-sf24 / hackathon
  ☆447Updated last year
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆842Updated 2 weeks ago
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆240Updated last year
• run-ai / llmperf
  ☆56Updated 9 months ago