huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆230Updated 3 months ago
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆184Updated last week
- PyTorch per step fault tolerance (actively under development)☆302Updated this week
- Load compute kernels from the Hub☆139Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆249Updated this week
- ☆190Updated 3 months ago
- Scalable and Performant Data Loading☆269Updated this week
- ☆210Updated 4 months ago
- ☆88Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆44Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆263Updated 7 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆301Updated last month
- ☆215Updated this week
- ☆179Updated last week
- An extension of the nanoGPT repository for training small MOE models.☆147Updated 2 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆380Updated last month
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆105Updated this week
- Google TPU optimizations for transformers models☆112Updated 4 months ago
- LLM KV cache compression made easy☆493Updated 3 weeks ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆546Updated this week
- Efficient LLM Inference over Long Sequences☆376Updated this week
- Inference server benchmarking tool☆67Updated last month
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆153Updated 7 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆374Updated this week
- Fast low-bit matmul kernels in Triton☆311Updated this week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆181Updated 3 weeks ago
- ☆157Updated last year
- kernels, of the mega variety☆329Updated this week
- This repository contains the experimental PyTorch native float8 training UX☆223Updated 10 months ago
- Best practices & guides on how to write distributed pytorch training code☆433Updated 3 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆258Updated 10 months ago