Alternatives and similar repositories for redis_cache

Users that are interested in redis_cache are comparing it to the libraries listed below

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆285Updated 5 months ago
• triton-inference-server / stateful_backend
  Triton backend for managing the model state tensors automatically in sequence batcher
  ☆17Updated last year
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆411Updated this week
• coreweave / ml-containers
  ☆43Updated last week
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆393Updated this week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆121Updated this week
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆155Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆171Updated last week
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆46Updated 3 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆171Updated last week
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆87Updated last week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆63Updated 8 months ago
• simon-mo / vLLM-Benchmark
  ☆31Updated 9 months ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 3 years ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆63Updated 4 months ago
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆152Updated 5 months ago
• GoogleCloudPlatform / slurm-gcp
  ☆60Updated this week
• rapidsai / ucx-py
  Python bindings for UCX
  ☆140Updated 4 months ago
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆153Updated last year
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆152Updated last year
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆215Updated 9 months ago
• AI-Hypercomputer / tpu-recipes
  ☆72Updated this week
• rapidsai / cuvs
  cuVS - a library for vector search and clustering on the GPU
  ☆615Updated this week
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆60Updated 2 years ago
• delta-incubator / deltatorch
  ☆59Updated 2 years ago
• google / saxml
  ☆151Updated 2 weeks ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• zilliztech / woodpecker
  A Cloud-Native WAL Storage Implementation
  ☆73Updated this week