Systematic and comprehensive benchmarks for LLM systems.
☆61Jan 28, 2026Updated 9 months ago
Alternatives and similar repositories for LMBenchmark
Users that are interested in LMBenchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆28Jul 29, 2025Updated last year
- KV cache store for distributed LLM inference☆449Sep 16, 2026Updated last month
- ☆27Updated this week
- ☆184Apr 23, 2026Updated 6 months ago
- ☆17Jun 14, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Phoenix is a direct hub between storage and xPU — plug in any accelerator (GPU/NPU) or AI app and stream data straight to the chip.☆29Oct 26, 2026Updated last week
- NVIDIA Inference Xfer Library (NIXL)☆1,350Updated this week
- TorFS is a plugin that enables RocksDB to access FDP SSDs☆18Jul 16, 2025Updated last year
- ☆21Mar 6, 2023Updated 3 years ago
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆332Oct 14, 2026Updated 2 weeks ago
- The driver for LMCache core to run in vLLM☆71Feb 4, 2025Updated last year
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- ☆19Apr 15, 2025Updated last year
- ☆174Oct 9, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆31Mar 28, 2025Updated last year
- ☆19May 28, 2024Updated 2 years ago
- A new memory mapping interface for efficient direct user-space access to byte-addressable storage, published in MICRO2022.☆15Sep 29, 2022Updated 4 years ago
- Offline optimization of your disaggregated Dynamo graph☆461Updated this week
- GeminiFS: A Companion File System for GPUs☆85Aug 11, 2026Updated 2 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,253Updated this week
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 8 months ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 9 months ago
- Configuration ZNS SSD emulator☆29Nov 19, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆379Updated this week
- the frontend of lmcache☆17Apr 22, 2026Updated 6 months ago
- ☆11Oct 16, 2026Updated 2 weeks ago
- ☆34Apr 17, 2025Updated last year
- ☆63May 16, 2025Updated last year
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆2,704Updated this week
- Slooo: A Fail-slow Fault Injection Testing Framework☆10Nov 28, 2022Updated 3 years ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆41Jul 12, 2026Updated 3 months ago
- Tutti is a GPU-centric KV Cache Store to make SSD work as DRAM.☆69Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆25Oct 22, 2026Updated last week
- A workload for deploying LLM inference services on Kubernetes☆313Updated this week
- AISimulate predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving clu…☆114Updated this week
- ☆134Updated this week
- The MPI parallel MD-Workbench simulates user activities.☆12Jun 23, 2019Updated 7 years ago
- Demonstration of MoE distributed training using various techniques☆11Oct 31, 2024Updated 2 years ago
- A Datacenter Scale Distributed Inference Serving Framework☆8,416Updated this week