amogkam / batch-inference-benchmarksLinks
☆17Updated last year
Alternatives and similar repositories for batch-inference-benchmarks
Users that are interested in batch-inference-benchmarks are comparing it to the libraries listed below
Sorting:
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- Distributed ML Optimizer☆32Updated 3 years ago
- ☆15Updated last year
- ☆14Updated last year
- Exoshuffle-CloudSort☆26Updated 2 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- ☆17Updated this week
- Lightning In-Memory Object Store☆46Updated 3 years ago
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Updated 3 years ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆97Updated 11 months ago
- Factorized Machine Learning with NumPy☆11Updated 4 years ago
- A lightweight, user-friendly data-plane for LLM training.☆16Updated last month
- MLFlow Deployment Plugin for Ray Serve☆44Updated 3 years ago
- Machine Learning Inference Graph Spec☆21Updated 5 years ago
- Demonstration of how to perform continuous model monitoring on CML using Model Metrics and Evidently.ai dashboards☆12Updated 5 months ago
- A collection of reproducible inference engine benchmarks☆31Updated last month
- Ray Framework (https://github.com/ray-project/ray) on Kubernetes☆12Updated 6 years ago
- Ray - A curated list of resources: https://github.com/ray-project/ray☆60Updated 4 months ago
- Three examples of recommendation system pipelines with NVIDIA Merlin and Redis☆59Updated last month
- Deadline-based hyperparameter tuning on RayTune.☆31Updated 5 years ago
- ☆17Updated 2 years ago
- Benchmark Datasets for Set Similarity Search☆12Updated 6 years ago
- Generate and train embeddings with a graph neural network and deploy as an API in a few lines of code☆9Updated 4 years ago
- Scaling Python Machine Learning☆46Updated last year
- Python and Scala APIs for enhanced Spark analytics☆12Updated 8 years ago
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- Runtime Tracing Library for TensorFlow☆43Updated 6 years ago
- ForestFlow is a policy-driven Machine Learning Model Server. It is an LF AI Foundation incubation project.☆73Updated last year
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Updated 11 months ago