☆51Dec 26, 2024Updated last year
Alternatives and similar repositories for glet
Users that are interested in glet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆109Dec 24, 2022Updated 3 years ago
- iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.☆39Jun 11, 2024Updated 2 years ago
- Fine-grained GPU sharing primitives☆149Jul 28, 2025Updated last year
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆58Aug 21, 2024Updated 2 years ago
- ☆84Feb 5, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆42May 29, 2022Updated 4 years ago
- Artifacts for our NSDI'23 paper TGS☆98Jun 10, 2024Updated 2 years ago
- An interference-aware scheduler for fine-grained GPU sharing☆166Nov 26, 2025Updated 11 months ago
- ☆20May 13, 2022Updated 4 years ago
- Multi-Instance-GPU profiling tool☆58Apr 16, 2023Updated 3 years ago
- [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆56Aug 6, 2025Updated last year
- Model-less Inference Serving☆95Nov 4, 2023Updated 3 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆14Mar 7, 2024Updated 2 years ago
- ☆23Jan 7, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official code repository for "CoVA: Exploiting Compressed-Domain Analysis to Accelerate Video Analytics [USENIX ATC 22]"☆21Sep 19, 2024Updated 2 years ago
- DIPPM: a Deep Learning Inference Performance Predictive Model using Graph Neural Networks☆10Aug 25, 2023Updated 3 years ago
- Deduplication over dis-aggregated memory for Serverless Computing☆14Mar 21, 2022Updated 4 years ago
- ☆32May 28, 2024Updated 2 years ago
- ☆10Dec 7, 2024Updated last year
- Source code of IPA, https://escholarship.org/uc/item/2p0805dq☆13Jun 27, 2024Updated 2 years ago
- Johnny Cache: the End of DRAM Cache Conflicts (in Tiered Main Memory Systems)☆21Aug 2, 2023Updated 3 years ago
- Horizontal Fusion☆24Jan 7, 2022Updated 4 years ago
- ☆52Dec 13, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- GPU-scheduler-for-deep-learning☆211Nov 5, 2020Updated 6 years ago
- This is the code repository for our work on resourcing-on-demand GPU provisioning for serverless deep learning serving.☆17Apr 17, 2026Updated 7 months ago
- ☆13Mar 28, 2025Updated last year
- ESPN: Embedding from Storage Pipelined Network. GDS implementation for multi-vector embedding retrieval and bindings.☆12May 18, 2024Updated 2 years ago
- ☆23May 30, 2025Updated last year
- [USENIX OSDI 2026] Revisiting Pipeline Parallelism for LLM Serving☆14Oct 30, 2026Updated 2 weeks ago
- ☆27Oct 30, 2026Updated 2 weeks ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆141Jul 25, 2024Updated 2 years ago
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆47Nov 24, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Source code for Jellyfish, a soft real-time inference serving system☆15Dec 20, 2022Updated 3 years ago
- Random collections of my interested research papers / projects☆20May 20, 2021Updated 5 years ago
- Resource Allocation for Dynamic Demands☆25Aug 28, 2026Updated 2 months ago
- High-Throughput Batch Inference☆22Updated this week
- Secure and Scalable Federated Learning using Serverless Computing☆14Jan 31, 2024Updated 2 years ago
- ☆16Aug 15, 2024Updated 2 years ago
- A Library for intra-GPU/Inter-SM parallelsim☆16Aug 7, 2026Updated 3 months ago
Are these results useful?