dlsyscourse / public_notebooksLinks
☆62Updated last year
Alternatives and similar repositories for public_notebooks
Users that are interested in public_notebooks are comparing it to the libraries listed below
Sorting:
- ☆51Updated 4 months ago
- ☆178Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆114Updated last year
- the public repo for stats205 scribe notes at Stanford University☆14Updated 4 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated 2 years ago
- Stanford CS149 -- Assignment 1☆141Updated 2 months ago
- Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…☆76Updated 4 years ago
- A guide to improve your research proposals.☆203Updated 5 years ago
- A work in progress. Trying to write about all interesting or necessary pieces in the current development of LLMs and generative AI. Gra…☆200Updated 2 years ago
- Custom kernels in Triton language for accelerating LLMs☆27Updated last year
- ☆405Updated last year
- ring-attention experiments☆161Updated last year
- Cataloging released Triton kernels.☆282Updated 3 months ago
- Personal solutions to the Triton Puzzles☆20Updated last year
- 📑 Dive into Big Model Training☆116Updated 3 years ago
- Collection of kernels written in Triton language☆174Updated 9 months ago
- CUDA tutorials for Maths & ML tutorials with examples, covers multi-gpus, fused attention, winograd convolution, reinforcement learning.☆206Updated 6 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73Updated last year
- Tutorials for writing high-performance GPU operators in AI frameworks.☆132Updated 2 years ago
- Torch Distributed Experimental☆117Updated last year
- From-scratch diffusion model implemented in PyTorch.☆99Updated last year
- ☆27Updated last month
- Learning material for CMU10-714: Deep Learning System☆293Updated last year
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆76Updated last year
- Building blocks for foundation models.☆587Updated 2 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆162Updated 2 weeks ago
- Awesome Triton Resources☆39Updated 8 months ago
- ☆176Updated 2 years ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆154Updated 2 years ago