Alternatives and similar repositories for clearml-fractional-gpu:

Users that are interested in clearml-fractional-gpu are comparing it to the libraries listed below

• run-ai / runai-model-streamer
  ☆169Updated this week
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆85Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 7 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆196Updated last month
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆23Updated this week
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 2 months ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆59Updated this week
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆200Updated 7 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆92Updated this week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆144Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆102Updated last month
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆48Updated 7 months ago
• substratusai / vllm-docker
  ☆54Updated 2 months ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆51Updated last month
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆76Updated last week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆260Updated 5 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆216Updated 2 weeks ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 2 months ago
• triton-inference-server / vllm_backend
  ☆235Updated this week
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated 10 months ago
• imbue-ai / cluster-health
  ☆295Updated 6 months ago
• backprop-ai / vllm-benchmark
  Benchmarking the serving capabilities of vLLM
  ☆33Updated 6 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆146Updated last month
• NVIDIA / NeMo-Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆123Updated this week
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆158Updated 2 weeks ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆70Updated 3 weeks ago
• kserve / website
  User documentation for KServe.
  ☆104Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆139Updated this week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆63Updated 11 months ago