SzymonOzog / PennyLinks
Hand-Rolled GPU communications library
☆76Updated 3 weeks ago
Alternatives and similar repositories for Penny
Users that are interested in Penny are comparing it to the libraries listed below
Sorting:
- Ship correct and fast LLM kernels to PyTorch☆126Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆64Updated last week
- Quantized LLM training in pure CUDA/C++.☆221Updated last week
- extensible collectives library in triton☆91Updated 8 months ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆178Updated this week
- High-Performance SGEMM on CUDA devices☆113Updated 11 months ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆427Updated last week
- ring-attention experiments☆160Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 9 months ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆140Updated this week
- Learning about CUDA by writing PTX code.☆150Updated last year
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆61Updated this week
- torchcomms: a modern PyTorch communications API☆309Updated this week
- Fast and Furious AMD Kernels☆321Updated last week
- LLM training in simple, raw C/CUDA☆108Updated last year
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆141Updated 3 months ago
- ☆263Updated this week
- ☆82Updated 2 weeks ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆456Updated this week
- A bunch of kernels that might make stuff slower 😉☆69Updated this week
- Fast low-bit matmul kernels in Triton☆410Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆415Updated last month
- ☆15Updated last month
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆691Updated this week
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆177Updated this week
- Cataloging released Triton kernels.☆278Updated 3 months ago
- Parallel framework for training and fine-tuning deep neural networks☆71Updated last month
- Nsight Python is a Python kernel profiling interface based on NVIDIA Nsight Tools☆77Updated this week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆244Updated 7 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆459Updated 2 weeks ago