IST-DASLab / llmqLinks
Quantized LLM training in pure CUDA/C++.
☆235Updated 2 weeks ago
Alternatives and similar repositories for llmq
Users that are interested in llmq are comparing it to the libraries listed below
Sorting:
- Learning about CUDA by writing PTX code.☆152Updated last year
- Write a fast kernel and run it on Discord. See how you compare against the best!☆68Updated this week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 10 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆200Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆197Updated 8 months ago
- Ship correct and fast LLM kernels to PyTorch☆140Updated 3 weeks ago
- MoE training for Me and You and maybe other people☆335Updated last month
- ☆286Updated this week
- Hand-Rolled GPU communications library☆81Updated 2 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆334Updated 3 months ago
- High-Performance FP32 GEMM on CUDA devices☆117Updated last year
- Simple MPI implementation for prototyping or learning☆300Updated 6 months ago
- coding CUDA everyday!☆73Updated last week
- SIMD quantization kernels☆94Updated 5 months ago
- Learn CUDA with PyTorch☆193Updated this week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆155Updated 2 years ago
- Fast low-bit matmul kernels in Triton☆427Updated last week
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆141Updated 4 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆249Updated 9 months ago
- Step by step implementation of a fast softmax kernel in CUDA☆60Updated last year
- ☆90Updated last month
- Dion optimizer algorithm☆424Updated 3 weeks ago
- ☆178Updated 2 years ago
- ring-attention experiments☆165Updated last year
- A bunch of kernels that might make stuff slower 😉☆75Updated last week
- mHC kernels implemented in CUDA☆249Updated 3 weeks ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆202Updated 2 years ago
- 👷 Build compute kernels☆214Updated last week
- Our first fully AI generated deep learning system☆481Updated this week
- ☆89Updated 2 months ago