Alternatives and similar repositories for llmperf-leaderboard

Users that are interested in llmperf-leaderboard are comparing it to the libraries listed below

• apoorvumang / prompt-lookup-decoding
  ☆567Updated last year
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆229Updated 9 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆228Updated last year
• nexusflowai / NexusRaven
  NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…
  ☆317Updated last year
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆1,088Updated last year
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,264Updated 6 months ago
• Snowflake-Labs / snowflake-arctic
  ☆547Updated last year
• scaleapi / llm-engine
  Scale LLM Engine public repository
  ☆811Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆315Updated last week
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆659Updated last year
• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆1,008Updated 9 months ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆188Updated last year
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆370Updated last year
• sabetAI / BLoRA
  batched loras
  ☆345Updated 2 years ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆423Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆621Updated 4 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆719Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆325Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• SkunkworksAI / hydra-moe
  ☆416Updated last year
• philschmid / easyllm
  ☆462Updated last year
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated last year
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆595Updated last year
• mistralai-sf24 / hackathon
  ☆447Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆310Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆466Updated last week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆266Updated 11 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated this week
• mistralai / megablocks-public
  ☆866Updated last year