☆53Dec 26, 2024Updated last year
Alternatives and similar repositories for glet
Users that are interested in glet are comparing it to the libraries listed below
Sorting:
- REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…☆105Dec 24, 2022Updated 3 years ago
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆43May 29, 2022Updated 3 years ago
- iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.☆39Jun 11, 2024Updated last year
- Artifacts for our NSDI'23 paper TGS☆96Jun 10, 2024Updated last year
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆58Aug 21, 2024Updated last year
- An interference-aware scheduler for fine-grained GPU sharing☆160Nov 26, 2025Updated 3 months ago
- ☆30May 28, 2024Updated last year
- Fine-grained GPU sharing primitives☆148Jul 28, 2025Updated 7 months ago
- ☆16Apr 22, 2025Updated 10 months ago
- ☆21May 13, 2022Updated 3 years ago
- Multi-Instance-GPU profiling tool☆58Apr 16, 2023Updated 2 years ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127May 9, 2022Updated 3 years ago
- Prefix-Aware Attention for LLM Decoding☆29Jan 23, 2026Updated last month
- [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆56Aug 6, 2025Updated 7 months ago
- Official code repository for "CoVA: Exploiting Compressed-Domain Analysis to Accelerate Video Analytics [USENIX ATC 22]"☆18Sep 19, 2024Updated last year
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 2 years ago
- Johnny Cache: the End of DRAM Cache Conflicts (in Tiered Main Memory Systems)☆20Aug 2, 2023Updated 2 years ago
- ☆38Jun 27, 2025Updated 8 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated 9 months ago
- Secure and Scalable Federated Learning using Serverless Computing☆12Jan 31, 2024Updated 2 years ago
- NS3 simulator for RDMA load balancing☆11Jan 31, 2025Updated last year
- SQL Optimizations using MLIR☆12Apr 5, 2020Updated 5 years ago
- ☆13Jan 21, 2022Updated 4 years ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated last year
- Compiler for Dynamic Neural Networks☆45Nov 13, 2023Updated 2 years ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆137Jul 25, 2024Updated last year
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆69May 1, 2024Updated last year
- Random collections of my interested research papers / projects☆20May 20, 2021Updated 4 years ago
- A minimum demo for PyTorch distributed extension functionality for collectives.☆15Jul 29, 2024Updated last year
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆47Nov 24, 2022Updated 3 years ago
- ☆23Dec 22, 2023Updated 2 years ago
- Model-less Inference Serving☆94Nov 4, 2023Updated 2 years ago
- ☆20Jun 1, 2025Updated 9 months ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 4 years ago
- Deduplication over dis-aggregated memory for Serverless Computing☆14Mar 21, 2022Updated 3 years ago
- 训练营训练方向项目☆26Jan 28, 2026Updated last month
- ☆12May 13, 2025Updated 9 months ago
- [AFK] Hardware router in Chisel (THU Network Joint Lab 2020)☆14Oct 8, 2020Updated 5 years ago
- Transformers components but in Triton☆34May 9, 2025Updated 10 months ago