Alternatives and similar repositories for clearml-fractional-gpu:

Users that are interested in clearml-fractional-gpu are comparing it to the libraries listed below

• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆86Updated last year
• run-ai / runai-model-streamer
  ☆205Updated last month
• run-ai / genv
  GPU environment and cluster management with LLM support
  ☆604Updated 11 months ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆57Updated 3 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆26Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆225Updated 2 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 9 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆199Updated 2 weeks ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆107Updated this week
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆205Updated 9 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 3 weeks ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆54Updated 9 months ago
• coreweave / ml-containers
  ☆30Updated last week
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆37Updated this week
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆197Updated 2 months ago
• NVIDIA / NeMo-Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆144Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆56Updated last week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated 2 months ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆62Updated last week
• cognitivecomputations / spectrum
  ☆115Updated 3 weeks ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆59Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 4 months ago
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆43Updated 3 weeks ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆150Updated 3 months ago
• imbue-ai / cluster-health
  ☆304Updated 8 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 3 months ago
• apple / ml-recurrent-drafter
  ☆209Updated 3 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 7 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆28Updated 5 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week