☆22Mar 11, 2026Updated 7 months ago
Alternatives and similar repositories for inference-benchmark
Users that are interested in inference-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆43Updated this week
- ☆14Oct 20, 2026Updated last week
- ☆19Feb 18, 2026Updated 8 months ago
- llm-d-batch-gateway is a standalone, backend-agnostic, OpenAI-compatible batch API and processing engine☆28Updated this week
- ☆17Jan 23, 2026Updated 9 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆36Updated this week
- ☆18Apr 8, 2026Updated 6 months ago
- 🌈 Default Icon Generator using the Open Color Palette and Pretendard☆11Jul 8, 2024Updated 2 years ago
- A Single Helm Template for Deploying Many Application to Kubernetes (Mono Chart)☆10May 30, 2026Updated 5 months ago
- GenAI inference performance benchmarking tool☆267Updated this week
- torchprime is a reference model implementation for PyTorch on TPU.☆49Mar 3, 2026Updated 7 months ago
- llm-d benchmark scripts and tooling☆76Updated this week
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 11 months ago
- Gateway API Inference Extension☆798Oct 19, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Snapshot gets GPU pods ready in seconds instead of minutes — by restoring a fully initialized GPU worker instead of starting one from scr…☆76Updated this week
- Aplus Framework Autoload Library☆18Oct 21, 2026Updated last week
- Hackathon Solution for the Expresso Churn Prediction Challenge by Data Science Nigeria☆14Aug 26, 2020Updated 6 years ago
- Node-level enforcement and metrics for fractional GPU allocations made by KAI Scheduler.☆51Updated this week
- Package chanstream implements an API compatible with and similiar to the TCP connection (and net.Conn as well) API, on top of Go channels…☆14Sep 2, 2020Updated 6 years ago
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆144Updated this week
- Prisma Server Deployment on AWS(Fargate, RDS) with CloudFormation☆17Aug 25, 2019Updated 7 years ago
- ☆132Updated this week
- ☆28Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving☆897Updated this week
- 🚀 Monorepo app template using ultra-runner☆20Nov 7, 2023Updated 2 years ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆84Dec 18, 2025Updated 10 months ago
- A Kubernetes context engine for humans and AI agents.☆16Jun 22, 2026Updated 4 months ago
- A tool for coordinated checkpoint/restore of distributed applications with CRIU☆36Jul 31, 2026Updated 2 months ago
- Controllable text-to-speech with natural language style prompts. Describe how speech should sound in plain English - Azure OpenAI GPT-5.1…☆27Apr 4, 2026Updated 6 months ago
- Implementation of Convolutional LSTM in PyTorch.☆28Apr 28, 2026Updated 6 months ago
- Compatibility layer to run Cloud Foundry applications on OpenShift☆11Sep 2, 2016Updated 10 years ago
- ☆28May 25, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A starting point for creating service brokers implementing the Open Service Broker API☆30Aug 11, 2017Updated 9 years ago
- [Deprecated] Vulnerability scanner for containers and images☆13Oct 26, 2015Updated 11 years ago
- Holistic job manager on Kubernetes☆117Feb 20, 2024Updated 2 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- Test Orchestrator for Performance and Scalability of AI pLatforms☆18Jun 23, 2026Updated 4 months ago
- generative language model training on top of the JAX and Huggingface 🤗☆10May 11, 2022Updated 4 years ago
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year