huggingface / kernel-builderLinks
π· Build compute kernels
β214Updated last week
Alternatives and similar repositories for kernel-builder
Users that are interested in kernel-builder are comparing it to the libraries listed below
Sorting:
- Load compute kernels from the Hubβ389Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.β334Updated 3 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)β66Updated 10 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understandβ197Updated 8 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!β68Updated this week
- β230Updated 2 months ago
- Simple & Scalable Pretraining for Neural Architecture Researchβ307Updated last month
- π Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flashβ¦β279Updated 2 months ago
- β219Updated last year
- Memory optimized Mixture of Expertsβ72Updated 6 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IPβ141Updated 4 months ago
- Google TPU optimizations for transformers modelsβ135Updated last week
- MoE training for Me and You and maybe other peopleβ335Updated last month
- β92Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on diskβ238Updated this week
- Ship correct and fast LLM kernels to PyTorchβ139Updated 3 weeks ago
- ring-attention experimentsβ165Updated last year
- Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face supportβ266Updated this week
- vLLM adapter for a TGIS-compatible gRPC server.β50Updated this week
- Where GPUs get cooked π©βπ³π₯β362Updated 2 weeks ago
- Official implementation for Training LLMs with MXFP4β118Updated 9 months ago
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learningβ287Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMsβ267Updated 2 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)β474Updated 3 weeks ago
- An extension of the nanoGPT repository for training small MOE models.β233Updated 10 months ago
- Efficient LLM Inference over Long Sequencesβ394Updated 7 months ago
- LM engine is a library for pretraining/finetuning LLMsβ113Updated this week
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"β252Updated last year
- Fast low-bit matmul kernels in Tritonβ424Updated last week
- mHC kernels implemented in CUDAβ243Updated 3 weeks ago