IST-DASLab / sparsepropLinks
☆15Updated 2 years ago
Alternatives and similar repositories for sparseprop
Users that are interested in sparseprop are comparing it to the libraries listed below
Sorting:
- This repository contains the experimental PyTorch native float8 training UX☆223Updated last year
- ☆16Updated this week
- Fast low-bit matmul kernels in Triton☆385Updated last week
- A library for unit scaling in PyTorch☆132Updated 3 months ago
- ☆152Updated 4 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆84Updated last year
- Collection of kernels written in Triton language☆159Updated 6 months ago
- The evaluation framework for training-free sparse attention in LLMs☆102Updated 2 weeks ago
- Experiment of using Tangent to autodiff triton☆80Updated last year
- Fast Hadamard transform in CUDA, with a PyTorch interface☆253Updated last week
- Work in progress.☆74Updated 4 months ago
- ☆335Updated last month
- Memory Optimizations for Deep Learning (ICML 2023)☆110Updated last year
- Load compute kernels from the Hub☆308Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆215Updated last week
- Code for studying the super weight in LLM☆119Updated 10 months ago
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆329Updated 10 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆183Updated this week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 10 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆197Updated 4 months ago
- Applied AI experiments and examples for PyTorch☆301Updated 2 months ago
- A block oriented training approach for inference time optimization.☆33Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆246Updated 3 weeks ago
- PB-LLM: Partially Binarized Large Language Models☆156Updated last year
- Cataloging released Triton kernels.☆263Updated last month
- extensible collectives library in triton☆90Updated 6 months ago
- Official implementation for Training LLMs with MXFP4☆100Updated 6 months ago
- ☆103Updated this week
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆118Updated last year
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆169Updated last year