mlops-discord / gpu-optimization-workshopLinks
Slides, notes, and materials for the workshop
☆334Updated last year
Alternatives and similar repositories for gpu-optimization-workshop
Users that are interested in gpu-optimization-workshop are comparing it to the libraries listed below
Sorting:
- ☆523Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 5 months ago
- 100 days of building GPU kernels!☆531Updated 6 months ago
- Best practices & guides on how to write distributed pytorch training code☆536Updated 3 weeks ago
- ☆545Updated last year
- ☆177Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆428Updated 8 months ago
- GPU Kernels☆206Updated 6 months ago
- Where GPUs get cooked 👩🍳🔥☆310Updated 2 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆822Updated 3 months ago
- Building blocks for foundation models.☆569Updated last year
- ☆77Updated last year
- UNet diffusion model in pure CUDA☆654Updated last year
- An ML Systems Onboarding list☆935Updated 9 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆113Updated 5 months ago
- ☆397Updated 7 months ago
- Learn CUDA with PyTorch☆104Updated last week
- GPU programming related news and material links☆1,787Updated 2 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆150Updated 2 years ago
- What would you do with 1000 H100s...☆1,121Updated last year
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆452Updated this week
- Triton implementation of GPT/LLAMA☆20Updated last year
- Some CUDA example code with READMEs.☆178Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆683Updated last week
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆126Updated 2 years ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆582Updated 3 months ago
- Notes from the Latent Space paper club. Follow along or start your own!☆241Updated last year
- ☆216Updated 10 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆195Updated 2 years ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆242Updated 6 months ago