Alternatives and similar repositories for simple_di

Users that are interested in simple_di are comparing it to the libraries listed below

• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆44Updated 3 years ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• project-codeflare / zero-copy-model-loading
  In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"
  ☆26Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆30Updated 3 weeks ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• bentoml / IF-multi-GPUs-demo
  ☆13Updated last year
• Systemcluster / kitoken
  Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…
  ☆24Updated last month
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• triton-inference-server / redis_cache
  TRITONCACHE implementation of a Redis cache
  ☆13Updated this week
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 2 months ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆95Updated this week
• msaroufim / torchprep
  ☆13Updated 2 years ago
• simon-mo / vLLM-Benchmark
  ☆25Updated 3 weeks ago
• coreweave / ml-containers
  ☆32Updated this week
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• fsspec / opendalfs
  OpenDAL fsspec integration
  ☆29Updated 4 months ago
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆60Updated last month
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆42Updated this week
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆46Updated this week
• MarvinSt / ray-docker-compose
  ☆23Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆72Updated 3 years ago
• npuichigo / blazing-fast-io-tutorial
  Blazing fast data loading with HuggingFace Dataset and Ray Data
  ☆16Updated last year
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆22Updated 2 months ago
• bentoml / yatai-image-builder
  🐳 Build OCI images for Bentos in k8s
  ☆18Updated last week
• zhao-lang / redis_hnsw
  HSNW module for Redis
  ☆57Updated 4 years ago
• bentoml / yatai-deployment
  🚀 Launching Bento in a Kubernetes cluster
  ☆17Updated 2 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 2 months ago