huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆357Updated last week
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆472Updated 2 weeks ago
- 👷 Build compute kernels☆214Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 7 months ago
- Load compute kernels from the Hub☆381Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆333Updated 2 months ago
- PyTorch Single Controller☆953Updated this week
- MoE training for Me and You and maybe other people☆331Updated 3 weeks ago
- Simple MPI implementation for prototyping or learning☆299Updated 5 months ago
- ☆178Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆68Updated this week
- Inference server benchmarking tool☆141Updated 3 months ago
- ☆219Updated last year
- ☆229Updated 2 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆280Updated 2 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆154Updated 2 years ago
- ☆278Updated last week
- A tool to configure, launch and manage your machine learning experiments.☆215Updated this week
- Scalable and Performant Data Loading☆362Updated last week
- Google TPU optimizations for transformers models☆133Updated last week
- ☆92Updated last year
- Best practices & guides on how to write distributed pytorch training code☆571Updated 3 months ago
- Slides, notes, and materials for the workshop☆338Updated last year
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆403Updated 3 weeks ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆272Updated this week
- Dion optimizer algorithm☆420Updated 2 weeks ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆141Updated 4 months ago
- Module, Model, and Tensor Serialization/Deserialization☆286Updated 5 months ago
- TPU inference for vLLM, with unified JAX and PyTorch support.☆223Updated this week
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆379Updated this week
- ☆114Updated 4 months ago