MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
☆198Mar 6, 2023Updated 3 years ago
Alternatives and similar repositories for ML-Model-CI
Users that are interested in ML-Model-CI are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving☆37Dec 27, 2019Updated 6 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Feb 22, 2021Updated 5 years ago
- 🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Mod…☆4,386Jul 25, 2025Updated last year
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127May 9, 2022Updated 4 years ago
- ☆26Nov 15, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Multi-Instance-GPU profiling tool☆59Apr 16, 2023Updated 3 years ago
- Simple Dynamic Batching Inference☆144Mar 8, 2022Updated 4 years ago
- Apply hot patches for running processes without restarting☆13Jun 1, 2020Updated 6 years ago
- Experiments evaluating preemption on the NVIDIA Pascal architecture☆16Nov 10, 2016Updated 9 years ago
- FedSTIL: Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges. (TCSVT'23)☆39Dec 12, 2024Updated last year
- Website for Systems Research Seminar at UIUC☆21Updated this week
- GPU-scheduler-for-deep-learning☆212Nov 5, 2020Updated 5 years ago
- [ICASSP'22] Continual Learning Benchmark for Spoken Keyword Spotting☆17Jun 7, 2022Updated 4 years ago
- Easy Multiprocessing for Python☆42Nov 3, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Rainbow Keywords - Official PyTorch Implementation☆14Jun 27, 2024Updated 2 years ago
- General system research material (not limited to paper) reading notes.☆22Mar 17, 2021Updated 5 years ago
- PRCV2020大规模行人检索竞赛（LSPRC）☆18Jul 1, 2020Updated 6 years ago
- Machine Learning Inference Graph Spec☆21Jul 27, 2019Updated 7 years ago
- Metis: Learning to Schedule Long-Running Applications in Shared Container Clusters with at Scale☆20May 27, 2020Updated 6 years ago
- A Distributed Camera System for Inference Scheduling and Continuous Learning in Video Analytics☆18Jun 26, 2023Updated 3 years ago
- 🏕️ Reproducible development environment for humans and agents☆2,230Jul 25, 2026Updated last month
- Extension to connect OpenPAI clusters, submit AI jobs, simulate jobs locally, manage files, and so on.☆15Dec 10, 2022Updated 3 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lightweight and Parallel Deep Learning Framework☆264Nov 26, 2022Updated 3 years ago
- ☆16Nov 2, 2022Updated 3 years ago
- ☆15Jan 10, 2023Updated 3 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 4 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆300Jun 7, 2025Updated last year
- Deploy ChatGLM on Modelz☆16Mar 20, 2023Updated 3 years ago
- This repository contains statistics about the AI Infrastructure products.☆16Feb 27, 2025Updated last year
- LightSeq: A High Performance Library for Sequence Processing and Generation☆3,294May 16, 2023Updated 3 years ago
- High-availably monitor for Apache Kudu by Prometheus☆16Aug 17, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Torch Distributed Experimental☆117Aug 5, 2024Updated 2 years ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆127Feb 23, 2022Updated 4 years ago
- PyTorch elastic training☆726Jun 15, 2022Updated 4 years ago
- This project can easily test the ncnn model and even deploy ncnn projects on python to speed up☆11Jul 27, 2019Updated 7 years ago
- 服务侧深度学习部署案例☆455Mar 27, 2020Updated 6 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 4 years ago
- The high-performance distributed tensor layer — load once, share everywhere.☆50Updated this week