kimbochen / md-blogsLinks
A blog where I write about research papers and blog posts I read.
☆12Updated 11 months ago
Alternatives and similar repositories for md-blogs
Users that are interested in md-blogs are comparing it to the libraries listed below
Sorting:
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆147Updated 2 years ago
- seqax = sequence modeling + JAX☆168Updated 3 months ago
- Solve puzzles. Learn CUDA.☆64Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆61Updated last week
- Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.☆24Updated last year
- ☆91Updated last year
- A really tiny autograd engine☆97Updated 5 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 5 months ago
- ☆46Updated last year
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆104Updated last month
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 7 months ago
- A puzzle to learn about prompting☆135Updated 2 years ago
- ML/DL Math and Method notes☆64Updated last year
- Simple Transformer in Jax☆139Updated last year
- train with kittens!☆63Updated last year
- ☆176Updated last year
- ☆29Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Updated last year
- ☆283Updated last year
- Experiment of using Tangent to autodiff triton☆79Updated last year
- A set of Python scripts that makes your experience on TPU better☆54Updated last month
- ☆28Updated last year
- Custom kernels in Triton language for accelerating LLMs☆26Updated last year
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆77Updated last month
- A MAD laboratory to improve AI architecture designs 🧪☆132Updated 10 months ago
- ☆89Updated last year
- Puzzles for exploring transformers☆376Updated 2 years ago
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 7 months ago
- Learn CUDA with PyTorch☆100Updated last month