Course on Flash-attention in Triton
☆104Feb 9, 2026Updated 8 months ago
Alternatives and similar repositories for gpu_llm_flash-attention
Users that are interested in gpu_llm_flash-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- KV Cache & LoRA for minGPT☆61Mar 4, 2026Updated 7 months ago
- Interactive version of the CuTe layout paper☆57Apr 14, 2026Updated 6 months ago
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 7 months ago
- ☆48Updated this week
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- From Minimal GEMM to Everything☆246Jul 9, 2026Updated 3 months ago
- The best ChatGPT that $100 can buy.☆60Updated this week
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,197Sep 12, 2026Updated last month
- A PyTorch implementation of the GPT-OSS-20B architecture. All components are coded from scratch: RoPE with YaRN, RMSNorm, SwiGLU with cla…☆237Dec 2, 2025Updated 10 months ago
- ☆58Mar 14, 2025Updated last year
- Code associated with the paper: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition.☆17May 16, 2025Updated last year
- FLA but cuTile☆27Apr 17, 2026Updated 6 months ago
- A distributed training framework based on torchtitan☆106Aug 17, 2026Updated 2 months ago
- Implementing scalable LLMs in pure JAX (no third-party libraries)☆56Jun 11, 2026Updated 4 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Personal solutions to the Triton Puzzles☆22Jul 18, 2024Updated 2 years ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆501Mar 10, 2025Updated last year
- Simple Transformer in Jax☆143Jun 22, 2024Updated 2 years ago
- a whirlwind tour to deep learning alchemy and deep learning systems☆95Updated this week
- Learn CUDA with PyTorch☆507Oct 3, 2026Updated 2 weeks ago
- minimal pytorch 4D parallelism☆74Feb 16, 2026Updated 8 months ago
- From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion, CLIP, LoRA, MoE and more, w…☆428Oct 7, 2026Updated last week
- NSA Triton Kernels written with GPT5 and Opus 4.1☆71Aug 12, 2025Updated last year
- A collection of lightweight interpretability scripts to understand how LLMs think☆92Mar 18, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The official repo for the Dialz Python library - a toolkit for steering vector research.☆28Mar 26, 2026Updated 6 months ago
- ☆19Mar 29, 2026Updated 6 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆17Jun 16, 2024Updated 2 years ago
- GPU programming related news and material links☆2,379Jun 15, 2026Updated 4 months ago
- ☆22Nov 9, 2024Updated last year
- ☆40Apr 3, 2025Updated last year
- ~1300 line, minimal, extensible LLM inference engine built from scratch.☆488Updated this week
- Large-batch Training, Neural Network Optimization☆11Nov 8, 2019Updated 6 years ago
- ☆14Jan 22, 2026Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- moodist☆29Sep 1, 2026Updated last month
- ☆22Dec 24, 2025Updated 9 months ago
- SR-DiT Speedrunning ImageNet Diffusion☆143Apr 6, 2026Updated 6 months ago
- Write a fast kernel and see how you compare against the best humans and AI on gpumode.com☆114Updated this week
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆124Feb 28, 2026Updated 7 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆81Updated this week
- Collection of useful kernels☆19Oct 3, 2025Updated last year