☆53Dec 26, 2024Updated last year
Alternatives and similar repositories for glet
Users that are interested in glet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆108Dec 24, 2022Updated 3 years ago
- iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.☆39Jun 11, 2024Updated 2 years ago
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆43May 29, 2022Updated 4 years ago
- Artifacts for our NSDI'23 paper TGS☆99Jun 10, 2024Updated 2 years ago
- ☆15Aug 5, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An interference-aware scheduler for fine-grained GPU sharing☆164Nov 26, 2025Updated 8 months ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127May 9, 2022Updated 4 years ago
- Fine-grained GPU sharing primitives☆150Jul 28, 2025Updated last year
- Multi-Instance-GPU profiling tool☆59Apr 16, 2023Updated 3 years ago
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆58Aug 21, 2024Updated last year
- ☆32May 28, 2024Updated 2 years ago
- ☆85Feb 5, 2026Updated 6 months ago
- Johnny Cache: the End of DRAM Cache Conflicts (in Tiered Main Memory Systems)☆20Aug 2, 2023Updated 3 years ago
- A Library for intra-GPU/Inter-SM parallelsim☆12Aug 7, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆56Aug 6, 2025Updated last year
- Secure and Scalable Federated Learning using Serverless Computing☆14Jan 31, 2024Updated 2 years ago
- ☆21May 13, 2022Updated 4 years ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆139Jul 25, 2024Updated 2 years ago
- Resource Allocation for Dynamic Demands☆22Dec 26, 2023Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆72May 1, 2024Updated 2 years ago
- Model-less Inference Serving☆94Nov 4, 2023Updated 2 years ago
- Random collections of my interested research papers / projects☆20May 20, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An efficient GPU resource sharing system with fine-grained control for Linux platforms.☆90Mar 25, 2024Updated 2 years ago
- ☆23Dec 22, 2023Updated 2 years ago
- GPU-scheduler-for-deep-learning☆213Nov 5, 2020Updated 5 years ago
- ☆54Dec 13, 2022Updated 3 years ago
- Network Contention-Aware Cluster Scheduling with Reinforcement Learning (IEEE ICPADS'23)☆20Jul 8, 2025Updated last year
- GCAPS: GPU Context-Aware Preemptive Scheduling Approach☆16Mar 22, 2026Updated 4 months ago
- Edge Video Services (EVS) is a Microsoft platform for developing video analytics solutions that can be deployed across the edge and the c…☆30Jul 5, 2022Updated 4 years ago
- Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"☆22Apr 13, 2024Updated 2 years ago
- SQL Optimizations using MLIR☆12Apr 5, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Transformers components but in Triton☆34May 9, 2025Updated last year
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆47Nov 24, 2022Updated 3 years ago
- SCV is a distributed cluster GPU sniffer. SCV是一个分布式GPU嗅探器☆20Feb 25, 2023Updated 3 years ago
- Compiler for Dynamic Neural Networks☆45Nov 13, 2023Updated 2 years ago
- Tencent Distribution of TVM☆16Apr 7, 2023Updated 3 years ago
- ☆27Feb 20, 2024Updated 2 years ago
- Kubernetes Scheduler Simulator☆127Jul 31, 2024Updated 2 years ago