fmperf-project / fmperfLinks
Cloud Native Benchmarking of Foundation Models
☆38Updated 2 weeks ago
Alternatives and similar repositories for fmperf
Users that are interested in fmperf are comparing it to the libraries listed below
Sorting:
- A tool to detect infrastructure issues on cloud native AI systems☆41Updated last month
- Systematic and comprehensive benchmarks for LLM systems.☆17Updated last week
- NVIDIA NCCL Tests for Distributed Training☆97Updated this week
- A light weight vLLM simulator, for mocking out replicas.☆26Updated this week
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆123Updated last year
- GenAI inference performance benchmarking tool☆61Updated this week
- Holistic job manager on Kubernetes☆116Updated last year
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆67Updated last month
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆179Updated 3 weeks ago
- Predict the performance of LLM inference services☆19Updated last month
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆83Updated last year
- Health checks for Azure N- and H-series VMs.☆45Updated this week
- Microsoft Collective Communication Library☆64Updated 7 months ago
- Repository to demo GPU Sharing with Time Slicing, MPS, MIG and others☆42Updated 8 months ago
- A tool for coordinated checkpoint/restore of distributed applications with CRIU☆25Updated last week
- Ultra and Unified CCL☆165Updated this week
- Intelligent platform for AI workloads☆37Updated 2 years ago
- Fine-grained GPU sharing primitives☆141Updated 5 years ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆117Updated last year
- NCCL Profiling Kit☆138Updated 11 months ago
- ☆26Updated 3 months ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆114Updated this week
- Inference scheduler for llm-d☆57Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆30Updated 6 months ago
- Automatic tuning for ML model deployment on Kubernetes☆80Updated 7 months ago
- ☆50Updated 3 months ago
- AppWrapper controller for Kueue☆15Updated 2 weeks ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆128Updated 11 months ago
- ☆55Updated 9 months ago