Alternatives and similar repositories for redis_cache

Users that are interested in redis_cache are comparing it to the libraries listed below

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆270Updated 2 months ago
• coreweave / ml-containers
  ☆39Updated this week
• triton-inference-server / stateful_backend
  Triton backend for managing the model state tensors automatically in sequence batcher
  ☆18Updated last year
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆155Updated last year
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆46Updated 3 years ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆297Updated last week
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆41Updated 2 years ago
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆395Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆162Updated last week
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• google / saxml
  ☆145Updated this week
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆34Updated 5 months ago
• Snowflake-Labs / vllm
  ☆15Updated last month
• rapidsai / ucx-py
  Python bindings for UCX
  ☆140Updated last month
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆149Updated last month
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• simon-mo / vLLM-Benchmark
  ☆31Updated 6 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated 2 weeks ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆149Updated last year
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆160Updated this week
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆11Updated last year
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆146Updated this week
• ray-project / plasma
  A minimal shared memory object store design
  ☆54Updated 8 years ago
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆384Updated 4 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated last month
• clearml / clearml-fractional-gpu
  ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing
  ☆81Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago