☆95Nov 16, 2026Updated this week
Alternatives and similar repositories for srt-slurm
Users that are interested in srt-slurm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark SGLang on SLURM☆25Apr 20, 2026Updated 6 months ago
- Official NVIDIA/srt-slurm sweep configs for benchmarking LLMs across NVIDIA GPUs and frameworks, spanning aggregated and disaggregated se…☆10Sep 18, 2026Updated last month
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆203Updated this week
- ☆14May 11, 2026Updated 6 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆356Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NVSentinel detects and remediates GPU faults on Kubernetes nodes☆442Updated this week
- Dashboard for InferenceX™, Open Source Continuous Inference | InferenceX 仪表板☆51Updated this week
- Run Slurm as a Kubernetes scheduler. A Slinky project.☆120Updated this week
- ☆29Updated this week
- Enhancement Proposals and Architecture Decisions☆13Oct 29, 2026Updated 2 weeks ago
- Open Source AI Accelerator Research Platform Standard / 开源推理研究平台☆2,051Updated this week
- Empowering LLM Agents for Real-World Computer System Optimization☆17Sep 10, 2025Updated last year
- ☆57Jul 12, 2026Updated 4 months ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆527Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆68Nov 9, 2026Updated last week
- ☆72Updated this week
- Evolutionary Autoresearch and Optimization of GPU Kernels.☆13Aug 25, 2026Updated 2 months ago
- ☆412Updated this week
- Stitch your rollouts together across clouds and regions☆40Updated this week
- ☆146May 10, 2026Updated 6 months ago
- NVIDIA NCCL Tests for Distributed Training☆162Updated this week
- Optimize SGEMM step by step☆10Sep 4, 2024Updated 2 years ago
- A PyTorch native library for training speculative decoding models☆268Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Aug 1, 2024Updated 2 years ago
- A collection of FIO test cases and a Python script to run them.☆11Sep 5, 2023Updated 3 years ago
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- ☆14Updated this week
- ☆28Jul 29, 2025Updated last year
- tooling to support clustermax.ai, the industry standard rating system for neoclouds | 为新型 GPU 云服务商(Neocloud)的行业标准评级体系 clustermax.ai 提供支持的…☆47Nov 10, 2026Updated last week
- A toolkit for discovering cluster network topology.☆209Updated this week
- The entry point for Rust projects to be run on Valida☆10Mar 14, 2025Updated last year
- Prometheus collector and exporter for Slurm cluster metrics. A Slinky project.☆18Nov 7, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- NVIDIA Fleet Intelligence Agent - Host agent for GPU telemetry collection and attestation☆61Updated this week
- NVIDIA Cluster Readiness Engine☆91Updated this week
- Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes☆480Updated this week
- Common recipes to run vLLM☆1,091Updated this week
- AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solu…☆887Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,289Updated this week
- Run scalable ML operations on tracto.ai, including model training, fine-tuning, and inference.☆10Sep 30, 2025Updated last year
Are these results useful?