huggingface / gpu-fryerLinks
Where GPUs get cooked 👩🍳🔥
☆234Updated 3 months ago
Alternatives and similar repositories for gpu-fryer
Users that are interested in gpu-fryer are comparing it to the libraries listed below
Sorting:
- PyTorch Single Controller☆231Updated this week
- PyTorch per step fault tolerance (actively under development)☆329Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆185Updated 3 weeks ago
- Load compute kernels from the Hub☆191Updated last week
- Scalable and Performant Data Loading☆278Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆399Updated 2 weeks ago
- ☆222Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆46Updated this week
- ☆213Updated 5 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆311Updated last month
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆358Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆253Updated last week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆425Updated 3 weeks ago
- LLM KV cache compression made easy☆520Updated last week
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated 11 months ago
- ☆88Updated last year
- Fast low-bit matmul kernels in Triton☆323Updated last week
- Efficient LLM Inference over Long Sequences☆378Updated 3 weeks ago
- Cray-LM unified training and inference stack.☆22Updated 4 months ago
- TorchFix - a linter for PyTorch-using code with autofix support☆143Updated 4 months ago
- A tool to configure, launch and manage your machine learning experiments.☆162Updated this week
- ☆126Updated last month
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…☆50Updated last week
- ☆183Updated this week
- Inference server benchmarking tool☆74Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆264Updated 8 months ago
- Google TPU optimizations for transformers models☆113Updated 5 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆556Updated last week
- Slides, notes, and materials for the workshop☆326Updated last year
- Applied AI experiments and examples for PyTorch☆277Updated 3 weeks ago