axonn-ai / axonn
A parallel framework for training deep neural networks
☆52Updated 3 weeks ago
Alternatives and similar repositories for axonn:
Users that are interested in axonn are comparing it to the libraries listed below
- extensible collectives library in triton☆83Updated 4 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆43Updated 7 months ago
- LLM training in simple, raw C/CUDA☆91Updated 9 months ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆104Updated 2 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated 11 months ago
- Experiment of using Tangent to autodiff triton☆75Updated last year
- FlexAttention w/ FlashAttention3 Support☆26Updated 4 months ago
- Collection of kernels written in Triton language☆105Updated this week
- Learning about CUDA by writing PTX code.☆35Updated 11 months ago
- ☆59Updated 2 weeks ago
- ☆25Updated last month
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆89Updated this week
- Cataloging released Triton kernels.☆168Updated last month
- ☆100Updated 5 months ago
- High-Performance SGEMM on CUDA devices☆76Updated last month
- End to End steps for adding custom ops in PyTorch.☆20Updated 4 years ago
- ☆67Updated 3 months ago
- ☆21Updated 3 months ago
- A hands-on introduction to tuning GPU kernels using Kernel Tuner https://github.com/KernelTuner/kernel_tuner/☆30Updated 5 months ago
- This repository contains the experimental PyTorch native float8 training UX☆221Updated 6 months ago
- ☆180Updated this week
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆64Updated 2 years ago
- Sparsity support for PyTorch☆33Updated last week
- Applied AI experiments and examples for PyTorch☆225Updated this week
- ☆17Updated 5 years ago
- ☆26Updated last year
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆43Updated last week
- PyTorch centric eager mode debugger☆46Updated 2 months ago
- Make triton easier☆44Updated 8 months ago
- Fastest kernels written from scratch☆173Updated last week