mlops-discord / gpu-optimization-workshopLinks
Slides, notes, and materials for the workshop
☆331Updated last year
Alternatives and similar repositories for gpu-optimization-workshop
Users that are interested in gpu-optimization-workshop are comparing it to the libraries listed below
Sorting:
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆190Updated 2 months ago
- GPU Kernels☆193Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆391Updated 5 months ago
- 100 days of building GPU kernels!☆489Updated 4 months ago
- Best practices & guides on how to write distributed pytorch training code☆470Updated 6 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆813Updated 3 weeks ago
- ☆527Updated last year
- An ML Systems Onboarding list☆877Updated 7 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆189Updated last year
- The Tensor (or Array)☆441Updated last year
- ☆163Updated last year
- Building blocks for foundation models.☆539Updated last year
- Where GPUs get cooked 👩🍳🔥☆277Updated 3 weeks ago
- UNet diffusion model in pure CUDA☆648Updated last year
- Some CUDA example code with READMEs.☆169Updated 5 months ago
- ☆362Updated 4 months ago
- What would you do with 1000 H100s...☆1,090Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆523Updated this week
- GPU programming related news and material links☆1,665Updated 7 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 2 months ago
- The Multilayer Perceptron Language Model☆558Updated last year
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆211Updated 3 months ago
- ☆75Updated last year
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆125Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆136Updated last year
- ☆192Updated 7 months ago
- Notes from the Latent Space paper club. Follow along or start your own!☆235Updated last year
- Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024☆247Updated last year
- For optimization algorithm research and development.☆530Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆389Updated 2 weeks ago