A flexible, high-performance serving system for machine learning models
☆6,363Oct 12, 2026Updated last week
Alternatives and similar repositories for serving
Users that are interested in serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,676Sep 17, 2026Updated last month
- Models and examples built with TensorFlow☆77,647Updated this week
- TFX is an end-to-end platform for deploying production ML pipelines☆2,192Updated this week
- The Cloud Native AI Platform☆15,920Sep 30, 2026Updated 3 weeks ago
- Integration of TensorFlow with other open-source frameworks☆1,377Sep 25, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆11,104Updated this week
- Input pipeline framework☆991Aug 14, 2026Updated 2 months ago
- An Open Source Machine Learning Framework for Everyone☆201,177Updated this week
- Serve, optimize and scale PyTorch models in production☆4,345Aug 6, 2025Updated last year
- Generic and easy-to-use serving service for machine learning models☆756Mar 20, 2025Updated last year
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆20,800Oct 25, 2023Updated 2 years ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single…☆28,901Updated this week
- A library for efficient similarity search and clustering of dense vectors.☆41,189Updated this week
- TensorFlow template application for deep learning☆1,875Jul 5, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Library for fast text representation and classification.☆26,523Mar 22, 2024Updated 2 years ago
- Deep Learning for humans☆64,376Updated this week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,848Jul 10, 2023Updated 3 years ago
- Build and run Docker containers leveraging NVIDIA GPUs☆17,600Dec 6, 2023Updated 2 years ago
- Model analysis tools for TensorFlow☆1,270Aug 14, 2026Updated 2 months ago
- Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.☆17,476Jun 2, 2023Updated 3 years ago
- Open standard for machine learning interoperability☆21,606Updated this week
- TensorFlow's Visualization Toolkit☆7,241Updated this week
- Simplified interface for TensorFlow (mimicking Scikit Learn) for Deep Learning☆3,165Aug 30, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- TensorFlow-based neural network library☆9,977Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆44,105Updated this week
- TensorFlow code and pre-trained models for BERT☆40,038Jul 23, 2024Updated 2 years ago
- An industrial deep learning framework for high-dimension sparse data☆4,301Sep 25, 2024Updated 2 years ago
- Deep learning with dynamic computation graphs in TensorFlow☆1,817Jun 26, 2021Updated 5 years ago
- A high performance and generic framework for distributed DNN training☆3,719Oct 3, 2023Updated 3 years ago
- Deep learning library featuring a higher-level API for TensorFlow.☆9,570May 6, 2024Updated 2 years ago
- A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used …☆18,903Updated this week
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models☆4,786Mar 23, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Learning to Rank in TensorFlow☆2,771Mar 18, 2024Updated 2 years ago
- AutoML library for deep learning☆9,337Nov 25, 2025Updated 10 months ago
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆14,322Oct 29, 2025Updated 11 months ago
- Open Machine Learning Compiler Framework☆13,855Updated this week
- A low-latency prediction-serving system☆1,421Apr 26, 2021Updated 5 years ago
- A library for transfer learning by reusing parts of TensorFlow models.☆3,530Jan 17, 2025Updated last year
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆28,494Updated this week