a-hamdi / native-sparse-attentionLinks
☆15Updated 6 months ago
Alternatives and similar repositories for native-sparse-attention
Users that are interested in native-sparse-attention are comparing it to the libraries listed below
Sorting:
- ☆199Updated 8 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆408Updated 6 months ago
- GPU Kernels☆193Updated 4 months ago
- 100 days of building GPU kernels!☆499Updated 4 months ago
- making the official triton tutorials actually comprehensible☆54Updated 3 weeks ago
- ☆367Updated 5 months ago
- LLaMA 2 implemented from scratch in PyTorch☆351Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆193Updated 3 months ago
- An extension of the nanoGPT repository for training small MOE models.☆187Updated 6 months ago
- ☆220Updated 7 months ago
- Cataloging released Triton kernels.☆257Updated 2 weeks ago
- This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…☆382Updated 7 months ago
- ☆14Updated 5 months ago
- Building blocks for foundation models.☆556Updated last year
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆573Updated this week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆221Updated 4 months ago
- ☆44Updated 4 months ago
- An ML Systems Onboarding list☆900Updated 7 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆159Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆576Updated last month
- coding CUDA everyday!☆61Updated 5 months ago
- ☆360Updated 8 months ago
- Notes on quantization in neural networks☆99Updated last year
- Best practices & guides on how to write distributed pytorch training code☆478Updated 6 months ago
- Learn CUDA with PyTorch☆78Updated this week
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆276Updated last month
- LLM KV cache compression made easy☆609Updated last week
- ☆535Updated last year
- This repository documents my 100-day journey of learning and writing CUDA kernels.☆13Updated 2 months ago
- Simple MPI implementation for prototyping or learning☆279Updated last month