tonyzhang617 / nomad-distLinks
☆37Updated last year
Alternatives and similar repositories for nomad-dist
Users that are interested in nomad-dist are comparing it to the libraries listed below
Sorting:
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆93Updated last month
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆51Updated 4 months ago
- Artifacts of EVT ASPLOS'24☆26Updated last year
- ☆19Updated 10 months ago
- ☆80Updated 6 months ago
- ☆27Updated last year
- Tile-based language built for AI computation across all scales☆31Updated this week
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆28Updated 7 months ago
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆56Updated this week
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆137Updated 2 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆216Updated last year
- Framework to reduce autotune overhead to zero for well known deployments.☆79Updated 2 weeks ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆30Updated 8 months ago
- ☆150Updated last year
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆50Updated last week
- llama INT4 cuda inference with AWQ☆54Updated 6 months ago
- ☆72Updated 9 months ago
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆18Updated 2 years ago
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆52Updated last year
- ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization☆109Updated 9 months ago
- ☆14Updated last year
- [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration☆225Updated 8 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆113Updated last year
- LLM-Inference-Bench☆48Updated 3 weeks ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆57Updated 3 weeks ago
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆64Updated last month
- ☆67Updated last year
- ☆85Updated 9 months ago
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆89Updated 2 years ago