gau-nernst / learn-cuda
Learn CUDA with PyTorch
☆19Updated 2 months ago
Alternatives and similar repositories for learn-cuda:
Users that are interested in learn-cuda are comparing it to the libraries listed below
- Write a fast kernel and run it on Discord. See how you compare against the best!☆38Updated this week
- Custom kernels in Triton language for accelerating LLMs☆18Updated last year
- Make triton easier☆47Updated 10 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆48Updated this week
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 11 months ago
- ☆21Updated last month
- ☆20Updated 11 months ago
- Custom triton kernels for training Karpathy's nanoGPT.☆18Updated 5 months ago
- Experiment of using Tangent to autodiff triton☆78Updated last year
- ☆76Updated 9 months ago
- ML/DL Math and Method notes☆60Updated last year
- Load compute kernels from the Hub☆113Updated this week
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆81Updated last year
- ☆20Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆17Updated 3 weeks ago
- This is a port of Mistral-7B model in JAX☆32Updated 9 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆129Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21Updated 2 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆60Updated last week
- Collection of autoregressive model implementation☆85Updated last month
- Proof-of-concept of global switching between numpy/jax/pytorch in a library.☆18Updated 9 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated this week
- ☆14Updated 9 months ago
- ☆100Updated 10 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆64Updated 3 weeks ago
- Various transformers for FSDP research☆37Updated 2 years ago
- ☆49Updated last year
- ☆17Updated last year
- ☆43Updated last year
- JAX implementation of the Mistral 7b v0.2 model☆35Updated 9 months ago