mlops-discord / gpu-optimization-workshopLinks
Slides, notes, and materials for the workshop
☆335Updated last year
Alternatives and similar repositories for gpu-optimization-workshop
Users that are interested in gpu-optimization-workshop are comparing it to the libraries listed below
Sorting:
- ☆621Updated this week
- Best practices & guides on how to write distributed pytorch training code☆546Updated last month
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆196Updated 6 months ago
- 100 days of building GPU kernels!☆544Updated 7 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆438Updated 8 months ago
- GPU Kernels☆209Updated 7 months ago
- ☆177Updated last year
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆829Updated 4 months ago
- ☆545Updated last year
- An ML Systems Onboarding list☆945Updated 10 months ago
- Where GPUs get cooked 👩🍳🔥☆319Updated 2 months ago
- Building blocks for foundation models.☆581Updated last year
- ☆77Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆152Updated 2 years ago
- Notes on quantization in neural networks☆111Updated last year
- ☆398Updated 7 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆196Updated 2 years ago
- GPU programming related news and material links☆1,825Updated 2 months ago
- Alex Krizhevsky's original code from Google Code☆198Updated 9 years ago
- Puzzles for exploring transformers☆380Updated 2 years ago
- ☆532Updated 4 months ago
- Llama from scratch, or How to implement a paper without crying☆581Updated last year
- UNet diffusion model in pure CUDA☆654Updated last year
- Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024☆248Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆584Updated 3 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆455Updated this week
- My own repository containing the codes I wrote to practice CUDA programming.☆63Updated 2 years ago
- ☆224Updated last week
- ☆222Updated 11 months ago
- What would you do with 1000 H100s...☆1,132Updated last year