SzymonOzog / PennyLinks
Hand-Rolled GPU communications library
☆39Updated this week
Alternatives and similar repositories for Penny
Users that are interested in Penny are comparing it to the libraries listed below
Sorting:
- Quantized LLM training in pure CUDA/C++.☆198Updated last week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated this week
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆377Updated last week
- High-Performance SGEMM on CUDA devices☆107Updated 8 months ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆155Updated last week
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆99Updated this week
- Learning about CUDA by writing PTX code.☆143Updated last year
- ☆42Updated last month
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 6 months ago
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆338Updated last week
- extensible collectives library in triton☆89Updated 6 months ago
- ring-attention experiments☆153Updated last year
- How to ensure correctness and ship LLM generated kernels in PyTorch☆66Updated this week
- A bunch of kernels that might make stuff slower 😉☆61Updated last week
- Parallel framework for training and fine-tuning deep neural networks☆65Updated 7 months ago
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆54Updated 2 weeks ago
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…☆68Updated 2 weeks ago
- ☆100Updated 4 months ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆114Updated 2 weeks ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆232Updated 5 months ago
- LLM training in simple, raw C/CUDA☆105Updated last year
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆131Updated last month
- PyTorch Single Controller☆438Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆98Updated 3 months ago
- Effective transpose on Hopper GPU☆25Updated last month
- ☆92Updated 11 months ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆83Updated last week
- ☆240Updated this week
- Make triton easier☆48Updated last year
- Collection of kernels written in Triton language☆156Updated 6 months ago