meta-pytorch / superblockLinks
A block oriented training approach for inference time optimization.
☆34Updated last year
Alternatives and similar repositories for superblock
Users that are interested in superblock are comparing it to the libraries listed below
Sorting:
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- ☆159Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆105Updated last year
- ☆110Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- extensible collectives library in triton☆88Updated 5 months ago
- Experiment of using Tangent to autodiff triton☆80Updated last year
- A library for unit scaling in PyTorch☆129Updated last month
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆119Updated last year
- Patch convolution to avoid large GPU memory usage of Conv2D☆92Updated 7 months ago
- Quantize transformers to any learned arbitrary 4-bit numeric format☆41Updated last month
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆174Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆353Updated 2 weeks ago
- ☆55Updated last year
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆30Updated last year
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆214Updated this week
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago
- ☆44Updated 9 months ago
- pytorch-profiler☆51Updated 2 years ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆224Updated last year
- ☆118Updated last year
- ☆81Updated 7 months ago
- ring-attention experiments☆149Updated 10 months ago
- Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.☆51Updated 2 years ago
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆52Updated 2 weeks ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆208Updated last week
- ☆36Updated 8 months ago
- ☆154Updated 2 years ago
- ☆123Updated 3 months ago
- Work in progress.☆72Updated 2 months ago