huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆285Updated 3 weeks ago
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆414Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆194Updated 4 months ago
- PyTorch Single Controller☆435Updated this week
- Load compute kernels from the Hub☆293Updated last week
- 👷 Build compute kernels☆155Updated this week
- Inference server benchmarking tool☆113Updated last week
- ☆89Updated last year
- Simple MPI implementation for prototyping or learning☆284Updated 2 months ago
- ☆173Updated last year
- ☆222Updated last week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆290Updated 2 months ago
- Slides, notes, and materials for the workshop☆332Updated last year
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆95Updated 2 weeks ago
- Scalable and Performant Data Loading☆304Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆269Updated 2 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆341Updated 5 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆144Updated last year
- SIMD quantization kernels☆87Updated last month
- Dion optimizer algorithm☆361Updated last week
- Cray-LM unified training and inference stack.☆22Updated 8 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆650Updated this week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆420Updated 7 months ago
- ☆255Updated last week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated 2 weeks ago
- Best practices & guides on how to write distributed pytorch training code☆494Updated this week
- Simple & Scalable Pretraining for Neural Architecture Research☆296Updated last month
- A tool to configure, launch and manage your machine learning experiments.☆197Updated this week
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆270Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆265Updated last year
- ☆106Updated last month