huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆282Updated last week
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆401Updated 3 weeks ago
- 👷 Build compute kernels☆143Updated this week
- PyTorch Single Controller☆419Updated this week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆193Updated 3 months ago
- Load compute kernels from the Hub☆283Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆274Updated last month
- ☆217Updated 7 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆605Updated last week
- Simple MPI implementation for prototyping or learning☆279Updated last month
- Inference server benchmarking tool☆100Updated 4 months ago
- ☆171Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆57Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆265Updated last month
- Scalable and Performant Data Loading☆302Updated this week
- Best practices & guides on how to write distributed pytorch training code☆478Updated 6 months ago
- ☆89Updated last year
- Dion optimizer algorithm☆343Updated 2 weeks ago
- ☆217Updated 7 months ago
- Slides, notes, and materials for the workshop☆331Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆142Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆187Updated 6 months ago
- Google TPU optimizations for transformers models☆120Updated 8 months ago
- For optimization algorithm research and development.☆538Updated this week
- TorchFix - a linter for PyTorch-using code with autofix support☆147Updated 3 weeks ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆408Updated 6 months ago
- ☆223Updated 2 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆335Updated 4 months ago
- ☆104Updated 2 weeks ago
- Simple & Scalable Pretraining for Neural Architecture Research☆293Updated 3 weeks ago
- code for training & evaluating Contextual Document Embedding models☆197Updated 4 months ago