vuhpdc / jellyfish
Source code for Jellyfish, a soft real-time inference serving system
☆12Updated 2 years ago
Alternatives and similar repositories for jellyfish
Users that are interested in jellyfish are comparing it to the libraries listed below
Sorting:
- a deep learning-driven scheduler for elastic training in deep learning clusters☆29Updated 4 years ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- ☆56Updated 3 years ago
- ☆49Updated 2 years ago
- ☆25Updated last year
- ☆11Updated 4 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆9Updated 3 years ago
- ☆14Updated 8 months ago
- Source code of IPA, https://escholarship.org/uc/item/2p0805dq☆10Updated 10 months ago
- ☆201Updated last year
- Our unique contributions are in tools/train/benchmark.☆19Updated 3 weeks ago
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆43Updated 2 years ago
- ☆20Updated 3 years ago
- ☆21Updated last year
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆40Updated 5 months ago
- A Distributed Camera System for Inference Scheduling and Continuous Learning in Video Analytics☆16Updated last year
- ☆16Updated last year
- HeliosArtifact☆20Updated 2 years ago
- This is a list of awesome edgeAI inference related papers.☆96Updated last year
- MobiSys#114☆21Updated last year
- THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression☆18Updated 9 months ago
- Metis: Learning to Schedule Long-Running Applications in Shared Container Clusters with at Scale☆18Updated 4 years ago
- Autodidactic Neurosurgeon Collaborative Deep Inference for Mobile Edge Intelligence via Online Learning☆42Updated 3 years ago
- ☆37Updated 3 years ago
- ☆42Updated 10 months ago
- ☆45Updated 2 years ago
- Source code and datasets for Ekya, a system for continuous learning on the edge.☆105Updated 3 years ago
- ☆10Updated 3 years ago
- ☆19Updated 3 years ago
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆22Updated 4 years ago