IST-DASLab / llmqLinks
Quantized LLM training in pure CUDA/C++.
☆233Updated last week
Alternatives and similar repositories for llmq
Users that are interested in llmq are comparing it to the libraries listed below
Sorting:
- Learning about CUDA by writing PTX code.☆151Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 10 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆200Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆68Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆197Updated 8 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆155Updated 2 years ago
- MoE training for Me and You and maybe other people☆331Updated 3 weeks ago
- coding CUDA everyday!☆73Updated this week
- Hand-Rolled GPU communications library☆81Updated 2 months ago
- Ship correct and fast LLM kernels to PyTorch☆139Updated 2 weeks ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆334Updated 3 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆249Updated 8 months ago
- Simple MPI implementation for prototyping or learning☆300Updated 5 months ago
- ☆277Updated this week
- Learn CUDA with PyTorch☆185Updated last week
- ☆178Updated last year
- High-Performance FP32 GEMM on CUDA devices☆117Updated last year
- SIMD quantization kernels☆94Updated 4 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆202Updated 2 years ago
- Dion optimizer algorithm☆420Updated 2 weeks ago
- ring-attention experiments☆165Updated last year
- ☆90Updated last month
- mHC kernels implemented in CUDA☆243Updated 2 weeks ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆141Updated 4 months ago
- Fast low-bit matmul kernels in Triton☆424Updated this week
- Cataloging released Triton kernels.☆291Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆457Updated 10 months ago
- ☆129Updated 3 months ago
- LLM training in simple, raw C/CUDA☆112Updated last year
- Our first fully AI generated deep learning system☆429Updated last week