Alternatives and similar repositories for redis_cache

Users that are interested in redis_cache are comparing it to the libraries listed below

• coreweave / ml-containers
  ☆43Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆279Updated 4 months ago
• triton-inference-server / stateful_backend
  Triton backend for managing the model state tensors automatically in sequence batcher
  ☆18Updated last year
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆407Updated last week
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆84Updated last month
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆167Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆170Updated 2 weeks ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 8 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆119Updated last week
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆62Updated 3 months ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last week
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆46Updated 3 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆34Updated 4 years ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• simon-mo / vLLM-Benchmark
  ☆31Updated 8 months ago
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆152Updated 4 months ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆356Updated this week
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆65Updated 2 years ago
• NVIDIA-Merlin / core
  Core Utilities for NVIDIA Merlin
  ☆19Updated last year
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆162Updated this week
• triton-inference-server / tensorflow_backend
  The Triton backend for TensorFlow.
  ☆55Updated last month
• NVIDIA-Merlin / systems
  Merlin Systems provides tools for combining recommendation models with other elements of production recommender systems (like feature sto…
  ☆94Updated last year
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• Snowflake-Labs / vllm
  ☆16Updated last month
• rapidsai / ucx-py
  Python bindings for UCX
  ☆140Updated 3 months ago
• meta-pytorch / autoparallel
  An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.
  ☆48Updated this week
• mlcommons / logging
  MLPerf™ logging library
  ☆37Updated last week