Quentin-Anthony / torch-profiling-tutorialLinks
☆532Updated 4 months ago
Alternatives and similar repositories for torch-profiling-tutorial
Users that are interested in torch-profiling-tutorial are comparing it to the libraries listed below
Sorting:
- Best practices & guides on how to write distributed pytorch training code☆552Updated 2 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 6 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆608Updated 6 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆441Updated 9 months ago
- (WIP) A small but powerful, homemade PyTorch from scratch.☆662Updated this week
- Learnings and programs related to CUDA☆429Updated 5 months ago
- Simple Transformer in Jax☆141Updated last year
- Dion optimizer algorithm☆404Updated last week
- ☆460Updated last year
- UNet diffusion model in pure CUDA☆656Updated last year
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆829Updated 4 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆327Updated last month
- Implementation of Diffusion Transformer (DiT) in JAX☆298Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆781Updated this week
- ☆285Updated last year
- Puzzles for exploring transformers☆380Updated 2 years ago
- For optimization algorithm research and development.☆553Updated this week
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆277Updated last year
- Simple MPI implementation for prototyping or learning☆293Updated 4 months ago
- ☆178Updated last year
- Solve puzzles. Learn CUDA.☆64Updated 2 years ago
- Following Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆172Updated last year
- ☆547Updated last year
- ☆212Updated last year
- A practical guide to diffusion models, implemented from scratch.☆196Updated 2 weeks ago
- Quantized LLM training in pure CUDA/C++.☆221Updated last week
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆75Updated 7 months ago
- This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…☆228Updated 11 months ago
- ☆213Updated last week
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆104Updated 2 months ago