huggingface / kernel-builderLinks
👷 Build compute kernels
☆163Updated this week
Alternatives and similar repositories for kernel-builder
Users that are interested in kernel-builder are comparing it to the libraries listed below
Sorting:
- Load compute kernels from the Hub☆304Updated last week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 7 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆296Updated 2 months ago
- ☆222Updated 3 weeks ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆193Updated 4 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆180Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated last week
- Simple & Scalable Pretraining for Neural Architecture Research☆297Updated 2 months ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆270Updated 3 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆133Updated last month
- ring-attention experiments☆154Updated last year
- Google TPU optimizations for transformers models☆120Updated 9 months ago
- ☆218Updated 9 months ago
- Efficient LLM Inference over Long Sequences☆390Updated 3 months ago
- ☆102Updated this week
- ☆89Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated last year
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆248Updated 8 months ago
- Learn CUDA with PyTorch☆92Updated last month
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆420Updated last week
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆147Updated last week
- Memory optimized Mixture of Experts☆68Updated 2 months ago
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning☆192Updated 2 months ago
- PyTorch implementation of models from the Zamba2 series.☆185Updated 9 months ago
- Where GPUs get cooked 👩🍳🔥☆293Updated last month
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- Train, tune, and infer Bamba model☆134Updated 4 months ago
- Fast low-bit matmul kernels in Triton☆381Updated 3 weeks ago
- Simple high-throughput inference library☆147Updated 5 months ago
- How to ensure correctness and ship LLM generated kernels in PyTorch☆66Updated last week