bentoml / simple_di

Related projects ⓘ

Alternatives and complementary repositories for simple_di

• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆27Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆14Updated last year
• bentoml / IF-multi-GPUs-demo
  ☆12Updated last year
• project-codeflare / zero-copy-model-loading
  In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"
  ☆26Updated 2 years ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆16Updated last year
• bentoml / diffusers-examples
  API serving for your diffusers models
  ☆10Updated 9 months ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆68Updated 3 years ago
• bentoml / yatai-deployment
  🚀 Launching Bento in a Kubernetes cluster
  ☆17Updated 7 months ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆42Updated 2 years ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆31Updated 3 years ago
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆56Updated last year
• zdevito / custom_loader
  ☆12Updated 3 years ago
• UmerHA / triton_util
  Make triton easier
  ☆41Updated 4 months ago
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆35Updated 3 months ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 3 years ago
• MagnivOrg / magniv-core
  Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.
  ☆76Updated 3 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆13Updated 10 months ago
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated 9 months ago
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 months ago
• fastai / fastrelease
  DEPRECATED--all functionality moved to nbdev
  ☆15Updated 2 years ago
• danyangz / lightning
  Lightning In-Memory Object Store
  ☆44Updated 2 years ago
• ploomber / soopervisor
  ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
  ☆45Updated last month
• JoeriHermans / awflow
  Reproducible research and reusable acyclic workflows in Python. Execute code on HPC systems as if you executed them on your personal comp…
  ☆18Updated 2 years ago
• anyscale / airflow-provider-ray
  Ray provider for Apache Airflow
  ☆47Updated 9 months ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆70Updated last year
• nunoplopes / torchy
  A tracing JIT compiler for PyTorch
  ☆12Updated 2 years ago
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆98Updated last month
• feast-dev / feast-java-old
  Feast Java Components
  ☆12Updated 2 years ago