Alternatives and similar repositories for batch-inference-benchmarks:

Users that are interested in batch-inference-benchmarks are comparing it to the libraries listed below

• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆31Updated 3 years ago
• exoshuffle / raysort
  ☆15Updated last year
• exoshuffle / cloudsort
  Exoshuffle-CloudSort
  ☆26Updated 2 years ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• SeldonIO / mlgraph
  Machine Learning Inference Graph Spec
  ☆21Updated 5 years ago
• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆94Updated 9 months ago
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• danyangz / lightning
  Lightning In-Memory Object Store
  ☆45Updated 3 years ago
• cioc / ray-kubernetes
  Ray Framework (https://github.com/ray-project/ray) on Kubernetes
  ☆12Updated 6 years ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆44Updated 2 years ago
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆43Updated last year
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆54Updated 2 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆124Updated last week
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆21Updated last month
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• mkuchnik / PlumberApp
  Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"
  ☆10Updated 3 years ago
• ADALabUCSD / MorpheusPy
  Factorized Machine Learning with NumPy
  ☆11Updated 4 years ago
• composable-logs / composable-logs
  Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documen…
  ☆18Updated last year
• amzn / amazon-ray
  Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.
  ☆66Updated last year
• bentoml / llm-bench
  ☆49Updated 4 months ago
• sfu-db / BOExplain
  Explaining Inference Queries with Bayesian Optimization
  ☆10Updated 4 years ago
• TU-Berlin-DIMA / Condor
  Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …
  ☆13Updated 9 months ago
• mllite / sklearn_explain
  Model explanation provides the ability to interpret the effect of the predictors on the composition of an individual score.
  ☆13Updated 4 years ago
• cloudera / cmlextensions
  Added functionality to the cml python package
  ☆14Updated 6 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆55Updated 2 years ago
• hpi-epic / ESPBench
  ESPBench - The Enterprise Stream Processing Benchmark
  ☆14Updated last year