☆51Dec 26, 2024Updated last year
Alternatives and similar repositories for glet
Users that are interested in glet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆108Dec 24, 2022Updated 3 years ago
- iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.☆39Jun 11, 2024Updated 2 years ago
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆58Aug 21, 2024Updated 2 years ago
- Fine-grained GPU sharing primitives☆149Jul 28, 2025Updated last year
- ☆84Feb 5, 2026Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆42May 29, 2022Updated 4 years ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆126May 9, 2022Updated 4 years ago
- Multi-Instance-GPU profiling tool☆58Apr 16, 2023Updated 3 years ago
- Artifacts for our NSDI'23 paper TGS☆98Jun 10, 2024Updated 2 years ago
- ☆20May 13, 2022Updated 4 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆14Mar 7, 2024Updated 2 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆165Nov 26, 2025Updated 11 months ago
- ☆16Aug 5, 2021Updated 5 years ago
- [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access