tonyzhang617 / nomad-dist
☆30Updated last year
Alternatives and similar repositories for nomad-dist:
Users that are interested in nomad-dist are comparing it to the libraries listed below
- LLM Inference analyzer for different hardware platforms☆62Updated 3 weeks ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆34Updated last week
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆50Updated 10 months ago
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆51Updated last year
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆86Updated 2 years ago
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆33Updated last month
- ☆13Updated 10 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆25Updated 2 months ago
- Explore Inter-layer Expert Affinity in MoE Model Inference☆8Updated 11 months ago
- ☆22Updated 2 years ago
- ☆31Updated last week
- DietCode Code Release☆63Updated 2 years ago
- ☆59Updated 10 months ago
- ☆19Updated 6 months ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆135Updated 2 years ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆82Updated this week
- Stateful LLM Serving☆63Updated last month
- ☆36Updated 2 years ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Updated 5 years ago
- ☆140Updated 9 months ago
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- Artifacts of EVT ASPLOS'24☆23Updated last year
- ☆26Updated last year
- Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…☆40Updated last year
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆26Updated 4 months ago
- ☆39Updated 10 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆35Updated last week
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆42Updated last month
- llama INT4 cuda inference with AWQ☆54Updated 3 months ago
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 5 months ago