ashvardanian / cuda-python-starter-kitLinks
Parallel Computing starter project to build GPU & CPU kernels in CUDA & C++ and call them from Python without a single line of CMake using PyBind11
☆29Updated 7 months ago
Alternatives and similar repositories for cuda-python-starter-kit
Users that are interested in cuda-python-starter-kit are comparing it to the libraries listed below
Sorting:
- LLM training in simple, raw C/CUDA☆105Updated last year
- Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers☆151Updated 9 months ago
- High-Performance SGEMM on CUDA devices☆107Updated 8 months ago
- ☆21Updated 7 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆144Updated last year
- Pipeline parallelism for the minimalist☆35Updated 2 months ago
- PyTorch Single Controller☆435Updated this week
- A list of awesome resources and blogs on topics related to Unum☆41Updated 11 months ago
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆64Updated 5 months ago
- Awesome utilities for performance profiling☆193Updated 7 months ago
- Implementation of "Efficient Multi-vector Dense Retrieval with Bit Vectors", ECIR 2024☆66Updated last year
- ☆24Updated this week
- extensible collectives library in triton☆89Updated 6 months ago
- Effective transpose on Hopper GPU☆24Updated last month
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated 2 weeks ago
- Parallel framework for training and fine-tuning deep neural networks☆65Updated 6 months ago
- Learn CUDA with PyTorch☆85Updated 2 weeks ago
- Lightweight Llama 3 8B Inference Engine in CUDA C☆48Updated 6 months ago
- Home for OctoML PyTorch Profiler☆114Updated 2 years ago
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆144Updated 6 months ago
- Quantized LLM training in pure CUDA/C++.☆180Updated this week
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆45Updated last month
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆194Updated 4 months ago
- Hand-Rolled GPU communications library☆37Updated this week
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆301Updated this week
- 👷 Build compute kernels☆155Updated this week
- TritonParse: A Compiler Tracer, Visualizer, and mini-Reproducer for Triton Kernels☆152Updated last week
- 🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.☆64Updated 8 months ago
- Learning about CUDA by writing PTX code.☆138Updated last year
- ☆28Updated 8 months ago