gau-nernst / learn-cuda
Learn CUDA with PyTorch
☆16Updated 3 weeks ago
Alternatives and similar repositories for learn-cuda:
Users that are interested in learn-cuda are comparing it to the libraries listed below
- ☆20Updated last year
- ☆21Updated 3 months ago
- ☆75Updated 7 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆46Updated this week
- Make triton easier☆44Updated 8 months ago
- Experiment of using Tangent to autodiff triton☆75Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆18Updated this week
- Custom triton kernels for training Karpathy's nanoGPT.☆16Updated 4 months ago
- ☆20Updated 9 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆118Updated last year
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 9 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆81Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21Updated last month
- Various transformers for FSDP research☆36Updated 2 years ago
- Collection of autoregressive model implementation☆81Updated last week
- ML/DL Math and Method notes☆58Updated last year
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆67Updated 8 months ago
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆82Updated 7 months ago
- ☆49Updated 11 months ago
- ☆91Updated 8 months ago
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆51Updated 10 months ago
- ☆17Updated last year
- ☆42Updated last year
- Triton Implementation of HyperAttention Algorithm☆46Updated last year
- ☆142Updated last year
- train with kittens!☆53Updated 3 months ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆48Updated last year
- ☆58Updated 2 years ago
- ☆86Updated 11 months ago
- ring-attention experiments☆123Updated 4 months ago