AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.
☆420Jul 3, 2026Updated this week
Alternatives and similar repositories for aiperf
Users that are interested in aiperf are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Kubernetes CSI Driver for serving OCI model artifacts☆27May 25, 2026Updated last month
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆76Updated this week
- ☆147Jun 9, 2026Updated 3 weeks ago
- ☆13Jun 18, 2024Updated 2 years ago
- High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and S…☆162Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A simple example of running a MongoDB instance to query a database☆10Aug 31, 2022Updated 3 years ago
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 2 years ago
- Rust (embedded-hal) driver for the HZ Grow R502 capacitive fingerprint sensor☆17Sep 27, 2020Updated 5 years ago
- OCI container images. A Slinky project.☆21Jul 2, 2026Updated last week
- Distributed KV cache scheduling & offloading libraries☆160Jun 30, 2026Updated last week
- ☆110May 31, 2025Updated last year
- Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B2…☆1,173Jun 30, 2026Updated last week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆308Jun 24, 2026Updated 2 weeks ago
- NVIDIA Inference Xfer Library (NIXL)☆1,117Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Repository for AI model benchmarking on TT-Buda☆16Feb 9, 2026Updated 4 months ago
- A tool for bandwidth measurements on NVIDIA GPUs.☆723Apr 8, 2026Updated 3 months ago
- A Datacenter Scale Distributed Inference Serving Framework☆7,412Updated this week
- Offline optimization of your disaggregated Dynamo graph☆353Updated this week
- ☆25Jun 24, 2022Updated 4 years ago
- A Kubernetes Operator to manage Node OS customizations.☆56Updated this week
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆228Jun 30, 2026Updated last week
- llm-d helm charts and deployment examples☆58May 1, 2026Updated 2 months ago
- Tools for generating TPC-* datasets☆32Jun 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This CLI tool and Python3 module collects the current system state for documentation☆27Apr 9, 2026Updated 3 months ago
- Like `kubectl get all`, but get really all resources☆34Jun 30, 2026Updated last week
- A workload for deploying LLM inference services on Kubernetes☆253Jun 29, 2026Updated last week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆472Jun 30, 2026Updated last week
- The Intelligent Inference Scheduler for Large-scale Inference Services.☆68Feb 12, 2026Updated 4 months ago
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆19Jan 12, 2026Updated 5 months ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- A high-performance and light-weight router for vLLM large scale deployment☆290Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆31Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆29Jun 30, 2026Updated last week
- SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models☆576Updated this week
- Think of it as an open-source alternative to expensive solutions like the MouthPad, eye-trackers, or even complex systems like Neuralink.…☆40Apr 20, 2026Updated 2 months ago
- German Dictation Mode for Talon Voice☆10Sep 29, 2025Updated 9 months ago
- Simple in memory data cache designed for ML applications. Built using Redis and Apache Arrow's Plasma in-memory store☆11Oct 13, 2020Updated 5 years ago
- ☆18Apr 21, 2026Updated 2 months ago
- Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes☆340Updated this week