huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆345Updated 3 months ago
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆465Updated last week
- 👷 Build compute kernels☆198Updated 2 weeks ago
- Load compute kernels from the Hub☆357Updated 3 weeks ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 7 months ago
- Inference server benchmarking tool☆135Updated 3 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆329Updated 2 months ago
- MoE training for Me and You and maybe other people☆315Updated this week
- ☆225Updated last month
- PyTorch Single Controller☆939Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆66Updated 2 weeks ago
- Simple MPI implementation for prototyping or learning☆297Updated 5 months ago
- ☆178Updated last year
- Scalable and Performant Data Loading☆360Updated last week
- Best practices & guides on how to write distributed pytorch training code☆562Updated 2 months ago
- ☆91Updated last year
- Dion optimizer algorithm☆413Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆212Updated last week
- ☆219Updated 11 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆325Updated 3 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆277Updated last month
- ☆275Updated this week
- Slides, notes, and materials for the workshop☆337Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆154Updated 2 years ago
- Simple & Scalable Pretraining for Neural Architecture Research☆306Updated last month
- ☆214Updated 2 weeks ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆141Updated 3 months ago
- Google TPU optimizations for transformers models☆133Updated 2 weeks ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆398Updated 6 months ago
- Quantized LLM training in pure CUDA/C++.☆230Updated this week
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆351Updated 8 months ago