vuhpdc / jellyfishLinks
Source code for Jellyfish, a soft real-time inference serving system
☆14Updated 2 years ago
Alternatives and similar repositories for jellyfish
Users that are interested in jellyfish are comparing it to the libraries listed below
Sorting:
- ☆211Updated last year
- ☆10Updated 4 years ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆35Updated 2 years ago
- ☆57Updated 3 years ago
- ☆15Updated last year
- Lucid: A Non-Intrusive, Scalable and Interpretable Scheduler for Deep Learning Training Jobs☆57Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Updated last year
- MobiSys#114☆22Updated 2 years ago
- Source code and datasets for Ekya, a system for continuous learning on the edge.☆111Updated 3 years ago
- This is a list of awesome edgeAI inference related papers.☆98Updated last year
- ☆51Updated 2 years ago
- iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.☆39Updated last year
- HeliosArtifact☆21Updated 3 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Updated 4 years ago
- THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression☆20Updated last year
- a deep learning-driven scheduler for elastic training in deep learning clusters☆31Updated 4 years ago
- ☆78Updated 2 years ago
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆22Updated 4 years ago
- ☆22Updated last year
- ☆38Updated 4 months ago
- Primo: Practical Learning-Augmented Systems with Interpretable Models☆19Updated last year
- ☆24Updated 2 years ago
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆71Updated last month
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Updated 2 years ago
- ☆16Updated 2 years ago
- ☆101Updated last year
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆35Updated 2 months ago
- ☆44Updated last year
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆45Updated 2 years ago
- ☆11Updated 4 years ago