lucasdelimanogueira / PyNorch
Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
☆145Updated 9 months ago
Alternatives and similar repositories for PyNorch:
Users that are interested in PyNorch are comparing it to the libraries listed below
- ☆136Updated 2 months ago
- Multi-Threaded FP32 Matrix Multiplication on x86 CPUs☆341Updated last month
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆174Updated last year
- Cataloging released Triton kernels.☆204Updated 2 months ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆129Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆306Updated last week
- The Tensor (or Array)☆427Updated 7 months ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆126Updated last year
- ☆151Updated last year
- ☆42Updated 2 weeks ago
- This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…☆302Updated last month
- ring-attention experiments☆127Updated 5 months ago
- Learnings and programs related to CUDA☆328Updated last month
- From zero to hero CUDA for accelerating maths and machine learning on GPU.☆180Updated 7 months ago
- A really tiny autograd engine☆90Updated 11 months ago
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆273Updated 2 months ago
- LLaMA 2 implemented from scratch in PyTorch☆307Updated last year
- pytorch from scratch in pure C/CUDA and python☆40Updated 5 months ago
- UNet diffusion model in pure CUDA☆600Updated 8 months ago
- Alex Krizhevsky's original code from Google Code☆190Updated 9 years ago
- Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…☆65Updated 4 years ago
- ☆158Updated last month
- Notes on "Programming Massively Parallel Processors" by Hwu, Kirk, and Hajj (4th ed.)☆52Updated 7 months ago
- Collection of kernels written in Triton language☆114Updated last month
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆524Updated last month
- High-Performance SGEMM on CUDA devices☆86Updated 2 months ago