Quentin-Anthony / torch-profiling-tutorialLinks
☆510Updated 2 months ago
Alternatives and similar repositories for torch-profiling-tutorial
Users that are interested in torch-profiling-tutorial are comparing it to the libraries listed below
Sorting:
- Best practices & guides on how to write distributed pytorch training code☆500Updated last week
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆547Updated 4 months ago
- (WIP) A small but powerful, homemade PyTorch from scratch.☆643Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆193Updated 4 months ago
- Learnings and programs related to CUDA☆420Updated 3 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆421Updated 7 months ago
- Dion optimizer algorithm☆369Updated 3 weeks ago
- ☆283Updated last year
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆820Updated 2 months ago
- Simple Transformer in Jax☆139Updated last year
- ☆456Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆658Updated this week
- For optimization algorithm research and development.☆542Updated last week
- Puzzles for exploring transformers☆373Updated 2 years ago
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆172Updated last year
- ☆174Updated last year
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆275Updated 11 months ago
- ☆541Updated last year
- The Tensor (or Array)☆448Updated last year
- ☆42Updated 9 months ago
- Solve puzzles. Learn CUDA.☆64Updated last year
- Quantized LLM training in pure CUDA/C++.☆206Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆296Updated 2 months ago
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆103Updated 3 weeks ago
- ☆211Updated last week
- Simple MPI implementation for prototyping or learning☆286Updated 2 months ago
- Implementation of Diffusion Transformer (DiT) in JAX☆295Updated last year
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆538Updated 2 weeks ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆145Updated 2 years ago
- SIMD quantization kernels☆87Updated last month