lucasdelimanogueira / PyNorchLinks
Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
☆151Updated 11 months ago
Alternatives and similar repositories for PyNorch
Users that are interested in PyNorch are comparing it to the libraries listed below
Sorting:
- ☆168Updated 5 months ago
- The Tensor (or Array)☆433Updated 9 months ago
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆183Updated last year
- ☆157Updated last year
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆132Updated 6 months ago
- CUDA tutorials for Maths & ML tutorials with examples, covers multi-gpus, fused attention, winograd convolution, reinforcement learning.☆183Updated last month
- UNet diffusion model in pure CUDA☆606Updated 11 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆544Updated this week
- Alex Krizhevsky's original code from Google Code☆192Updated 9 years ago
- A really tiny autograd engine☆94Updated last week
- Multi-Threaded FP32 Matrix Multiplication on x86 CPUs☆351Updated last month
- Cataloging released Triton kernels.☆226Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆357Updated 2 months ago
- ☆328Updated last month
- Annotated version of the Mamba paper☆482Updated last year
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆184Updated last week
- An ML Systems Onboarding list☆794Updated 4 months ago
- making the official triton tutorials actually comprehensible☆34Updated 2 months ago
- An extension of the nanoGPT repository for training small MOE models.☆147Updated 2 months ago
- Learning about CUDA by writing PTX code.☆131Updated last year
- ring-attention experiments☆143Updated 7 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆181Updated 3 weeks ago
- Implementation of Diffusion Transformer (DiT) in JAX☆276Updated 11 months ago
- GPU Kernels☆178Updated last month
- The Autograd Engine☆609Updated 8 months ago
- LLaMA 2 implemented from scratch in PyTorch☆328Updated last year
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆359Updated 4 months ago
- This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…☆348Updated 3 months ago
- ☆255Updated 4 months ago
- ☆54Updated this week