huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆294Updated last month
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆441Updated last week
- 👷 Build compute kernels☆163Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆194Updated 5 months ago
- Load compute kernels from the Hub☆308Updated last week
- PyTorch Single Controller☆840Updated this week
- ☆174Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated 3 weeks ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆301Updated this week
- Simple MPI implementation for prototyping or learning☆287Updated 2 months ago
- ☆225Updated 2 weeks ago
- Inference server benchmarking tool☆121Updated last month
- Scalable and Performant Data Loading☆330Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆666Updated last week
- Dion optimizer algorithm☆374Updated last month
- A tool to configure, launch and manage your machine learning experiments.☆203Updated this week
- ☆218Updated 9 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆270Updated 3 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆137Updated last month
- Best practices & guides on how to write distributed pytorch training code☆526Updated last week
- ☆89Updated last year
- PyTorch-native post-training at scale☆479Updated this week
- Slides, notes, and materials for the workshop☆333Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆147Updated 2 years ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆387Updated 4 months ago
- ☆262Updated 2 weeks ago
- Learn CUDA with PyTorch☆95Updated last month
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 7 months ago
- ☆231Updated 4 months ago
- Quantized LLM training in pure CUDA/C++.☆209Updated this week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆425Updated 7 months ago