meta-pytorch / superblockLinks
A block oriented training approach for inference time optimization.
☆33Updated 11 months ago
Alternatives and similar repositories for superblock
Users that are interested in superblock are comparing it to the libraries listed below
Sorting:
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- A library for unit scaling in PyTorch☆128Updated last month
- ☆158Updated last year
- Experiment of using Tangent to autodiff triton☆80Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆102Updated last year
- extensible collectives library in triton☆88Updated 4 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆152Updated last month
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Updated 10 months ago
- ring-attention experiments☆147Updated 9 months ago
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆118Updated last year
- A bunch of kernels that might make stuff slower 😉☆56Updated last week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆199Updated this week
- Work in progress.☆70Updated last month
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- Patch convolution to avoid large GPU memory usage of Conv2D☆92Updated 6 months ago
- The evaluation framework for training-free sparse attention in LLMs☆88Updated last month
- ☆80Updated 6 months ago
- ☆21Updated 5 months ago
- ☆114Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆142Updated this week
- Fast Hadamard transform in CUDA, with a PyTorch interface☆215Updated last year
- ☆108Updated 11 months ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago
- Quantize transformers to any learned arbitrary 4-bit numeric format☆39Updated last month
- ☆123Updated 2 months ago
- Prototype routines for GPU quantization written using PyTorch.☆21Updated last week
- ☆53Updated last year
- Boosting 4-bit inference kernels with 2:4 Sparsity☆80Updated 11 months ago
- Code for studying the super weight in LLM☆115Updated 8 months ago