sjtu-epcc / DVABatch
☆18Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for DVABatch
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆54Updated 2 months ago
- ☆37Updated 3 years ago
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆39Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆8Updated 8 months ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆23Updated last year
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆19Updated 3 years ago
- Benchmark for matrix multiplications between dense and block sparse (BSR) matrix in TVM, blocksparse (Gray et al.) and cuSparse.☆24Updated 4 years ago
- ☆14Updated 2 years ago
- ☆8Updated last year
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆17Updated 2 years ago
- SOTA Learning-augmented Systems☆32Updated 2 years ago
- Artifacts for our ASPLOS'23 paper ElasticFlow☆52Updated 6 months ago
- ☆22Updated 2 years ago
- Artifact of ASPLOS'23 paper entitled: GRACE: A Scalable Graph-Based Approach to Accelerating Recommendation Model Inference☆16Updated last year
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆33Updated last year
- ☆17Updated 3 years ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆49Updated 3 months ago
- ☆22Updated last year
- ☆21Updated last year
- ☆41Updated last year
- ☆14Updated 3 years ago
- ☆16Updated last year
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆10Updated last month
- ☆21Updated 6 years ago
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆57Updated 6 months ago
- Artifact for PPoPP22 QGTC: Accelerating Quantized GNN via GPU Tensor Core.☆27Updated 2 years ago
- ☆17Updated 4 years ago
- ☆44Updated last year
- An external memory allocator example for PyTorch.☆13Updated 3 years ago
- ☆38Updated 4 years ago