tonyzhang617 / nomad-dist
☆32Updated last year
Alternatives and similar repositories for nomad-dist
Users that are interested in nomad-dist are comparing it to the libraries listed below
Sorting:
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆44Updated last month
- ☆19Updated 7 months ago
- LLM Inference analyzer for different hardware platforms☆66Updated 2 weeks ago
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆34Updated 3 weeks ago
- ☆14Updated 11 months ago
- Artifacts of EVT ASPLOS'24☆24Updated last year
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆51Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆36Updated 3 weeks ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆25Updated 3 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆85Updated this week
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆50Updated 11 months ago
- ☆39Updated 11 months ago
- ☆70Updated 3 months ago
- ☆144Updated 9 months ago
- llama INT4 cuda inference with AWQ☆54Updated 3 months ago
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆88Updated 2 years ago
- ☆55Updated last year
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆35Updated last month
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆18Updated 2 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆28Updated 6 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆23Updated last week
- ☆37Updated 2 years ago
- TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators☆38Updated 2 months ago
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 5 months ago
- Cavs: An Efficient Runtime System for Dynamic Neural Networks☆14Updated 4 years ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆50Updated 9 months ago
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆137Updated 2 years ago
- ☆30Updated 2 years ago
- ☆60Updated 11 months ago