amogkam / batch-inference-benchmarksLinks
☆18Updated 2 years ago
Alternatives and similar repositories for batch-inference-benchmarks
Users that are interested in batch-inference-benchmarks are comparing it to the libraries listed below
Sorting:
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆99Updated last year
- Exoshuffle-CloudSort☆27Updated 2 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- ☆15Updated 2 years ago
- Lightning In-Memory Object Store☆47Updated 3 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 3 years ago
- ForestFlow is a policy-driven Machine Learning Model Server. It is an LF AI Foundation incubation project.☆73Updated last year
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆132Updated this week
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.☆160Updated last week
- Ray-based Apache Beam runner☆41Updated 2 years ago
- Code for Ernest☆33Updated 2 years ago
- Deadline-based hyperparameter tuning on RayTune.☆31Updated 5 years ago
- Spark RAPIDS MLlib – accelerate Apache Spark MLlib with GPUs☆83Updated last week
- Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark☆53Updated 6 years ago
- Distributed ML Optimizer☆32Updated 4 years ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆24Updated last year
- SnailTrail implementation☆39Updated 6 years ago
- Machine Learning Inference Graph Spec☆21Updated 6 years ago
- A minimal shared memory object store design☆54Updated 8 years ago
- Examples for using Amazon SageMaker components in Kubeflow Pipelines☆22Updated 5 years ago
- Trisk on Flink☆16Updated 3 years ago
- Tracking Ray Enhancement Proposals☆55Updated 5 months ago
- Flow with FlorDB 🌻☆154Updated last week
- Serverless ML Framework☆106Updated 3 years ago
- ☆30Updated 3 years ago
- The Internals of PySpark☆26Updated 8 months ago
- This repository contains statistics about the AI Infrastructure products.☆17Updated 7 months ago
- Studying GPU Multi-tenancy☆12Updated 6 years ago