MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
☆198Mar 6, 2023Updated 3 years ago
Alternatives and similar repositories for ML-Model-CI
Users that are interested in ML-Model-CI are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving☆37Dec 27, 2019Updated 6 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Feb 22, 2021Updated 5 years ago
- 🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Mod…☆4,435Jul 25, 2025Updated last year
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆126May 9, 2022Updated 4 years ago
- ☆26Nov 15, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Multi-Instance-GPU profiling tool☆58Apr 16, 2023Updated 3 years ago
- Simple Dynamic Batching Inference☆144Mar 8, 2022Updated 4 years ago
- Apply hot patches for running processes without restarting☆13Jun 1, 2020Updated 6 years ago
- Studying GPU Multi-tenancy☆11Jan 11, 2019Updated 7 years ago
- Violet: Selective Symbolic Execution to Detect Bad Performance Misconfiguration☆18Oct 16, 2020Updated 6 years ago
- ☆10Jul 5, 2023Updated 3 years ago
- Experiments evaluating preemption on the NVIDIA Pascal architecture☆16Nov 10, 2016Updated 9 years ago
- Website for Systems Research Seminar at UIUC☆21Sep 18, 2026Updated last month
- GPU-scheduler-for-deep-learning☆211Nov 5, 2020Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Empowering LLM Agents for Real-World Computer System Optimization☆17Sep 10, 2025Updated last year
- [ICASSP'22] Continual Learning Benchmark for Spoken Keyword Spotting☆17Jun 7, 2022Updated 4 years ago
- A runtime python code manipulation framework for profiling, debugging and bugfixing☆66Aug 22, 2022Updated 4 years ago
- Server-driven Video Streaming for Deep Learning Inference☆91Jun 28, 2022Updated 4 years ago
- Rainbow Keywords - Official PyTorch Implementation☆14Jun 27, 2024Updated 2 years ago
- Easy Multiprocessing for Python☆42Nov 3, 2020Updated 5 years ago
- General system research material (not limited to paper) reading notes.☆22Mar 17, 2021Updated 5 years ago
- PRCV2020大规模行人检索竞赛(LSPRC)☆18Jul 1, 2020Updated 6 years ago
- Machine Learning Inference Graph Spec☆21Jul 27, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Distributed Camera System for Inference Scheduling and Continuous Learning in Video Analytics☆18Jun 26, 2023Updated 3 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 4 years ago
- The road to hack SysML and become an system expert☆520Oct 7, 2026Updated last week
- Metis: Learning to Schedule Long-Running Applications in Shared Container Clusters with at Scale☆20May 27, 2020Updated 6 years ago
- Lightweight and Parallel Deep Learning Framework☆264Nov 26, 2022Updated 3 years ago
- ☆42Sep 8, 2023Updated 3 years ago
- pytorch DDP☆10Nov 12, 2019Updated 6 years ago
- ☆15Jan 10, 2023Updated 3 years ago
- Public code for LOA☆19Oct 5, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 4 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆300Jun 7, 2025Updated last year
- PyTorch elastic training☆726Jun 15, 2022Updated 4 years ago
- This repository contains statistics about the AI Infrastructure products.☆16Feb 27, 2025Updated last year
- Torch Distributed Experimental☆117Aug 5, 2024Updated 2 years ago
- This project can easily test the ncnn model and even deploy ncnn projects on python to speed up☆11Jul 27, 2019Updated 7 years ago
- Improve Person Re-Identification With Part Awareness Learning, TIP 2020☆18Aug 31, 2020Updated 6 years ago