SzymonOzog / PennyLinks
Hand-Rolled GPU communications library
☆76Updated last month
Alternatives and similar repositories for Penny
Users that are interested in Penny are comparing it to the libraries listed below
Sorting:
- High-Performance SGEMM on CUDA devices☆115Updated 11 months ago
- Quantized LLM training in pure CUDA/C++.☆230Updated last week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆66Updated this week
- Fast and Furious AMD Kernels☆331Updated 2 weeks ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆439Updated 3 weeks ago
- Ship correct and fast LLM kernels to PyTorch☆130Updated this week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 9 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆188Updated 3 weeks ago
- Learning about CUDA by writing PTX code.☆151Updated last year
- ☆83Updated last month
- extensible collectives library in triton☆91Updated 9 months ago
- ring-attention experiments☆161Updated last year
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆706Updated this week
- CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning☆294Updated this week
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…☆91Updated this week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆247Updated 8 months ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆148Updated this week
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆141Updated 4 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 7 months ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆182Updated this week
- Fast low-bit matmul kernels in Triton☆418Updated 3 weeks ago
- Samples of good AI generated CUDA kernels☆99Updated 7 months ago
- ☆270Updated last week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆443Updated last week
- LLM training in simple, raw C/CUDA☆109Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆154Updated 2 years ago
- 👷 Build compute kernels☆201Updated this week
- A bunch of kernels that might make stuff slower 😉☆73Updated this week
- TPU inference for vLLM, with unified JAX and PyTorch support.☆207Updated this week
- Parallel framework for training and fine-tuning deep neural networks☆69Updated 2 months ago