coreweave / ml-containers

Related projects: ⓘ

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆175Updated 3 weeks ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆59Updated last month
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆66Updated last week
• onnx / neural-compressor
  Model compression for ONNX
  ☆67Updated last week
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆41Updated 2 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆117Updated last week
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆80Updated 7 months ago
• klueska / nvkind
  ☆43Updated 3 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆193Updated 5 months ago
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆200Updated 2 months ago
• triton-inference-server / vllm_backend
  ☆170Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆95Updated this week
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆29Updated 2 weeks ago
• leptonai / gpud
  ☆158Updated this week
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated last week
• kserve / modelmesh-performance
  ModelMesh Performance Scripts, Dashboard and Pipelines
  ☆10Updated last year
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆121Updated this week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆178Updated last week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆163Updated this week
• NVIDIA / nephele
  Tools to deploy GPU clusters in the Cloud
  ☆30Updated last year
• imbue-ai / cluster-health
  ☆225Updated last month
• NVIDIA / gpu-driver-container
  The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.
  ☆62Updated this week
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆62Updated 2 weeks ago
• run-ai / docs
  markdown docs
  ☆62Updated this week
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆124Updated 2 weeks ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆122Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆52Updated this week
• CentaurusInfra / alnair
  Intelligent platform for AI workloads
  ☆37Updated last year
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆147Updated 2 weeks ago
• kserve / modelmesh-runtime-adapter
  Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
  ☆21Updated 2 months ago