Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
☆168Nov 25, 2025Updated 11 months ago
Alternatives and similar repositories for PyNorch
Users that are interested in PyNorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12May 8, 2026Updated 6 months ago
- SSA based compiler targeting x86_64☆12Oct 22, 2021Updated 5 years ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆29Jan 27, 2026Updated 9 months ago
- ☆10Sep 30, 2023Updated 3 years ago
- Triton implementation of GPT/LLAMA☆21Aug 28, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆47May 24, 2025Updated last year
- UNet diffusion model in pure CUDA☆668Jun 28, 2024Updated 2 years ago
- Machine translation with tinygrad☆19Apr 7, 2024Updated 2 years ago
- A zero-dependency ML framework in C with a modern Python API for full control over execution and memory.☆709Updated this week
- Model-to-NPU pipelines for Qualcomm Snapdragon: QNN/ONNX/Android runtimes for on-device image and video generation.☆14Oct 11, 2026Updated last month
- Tensor implementation in C☆12Jul 17, 2024Updated 2 years ago
- Sample codes for parallel programming using OpenMP on CPU and CUDA on GPU☆10Jul 21, 2022Updated 4 years ago
- Parameter-efficient transformer embeddings replace learned embeddings with hardware-aware polynomial expansions of token IDs.☆13Feb 6, 2026Updated 9 months ago
- Powerful Asynchronous Multi agent framework built from scratch in python supporting RAG and MCP compatibilities.☆12Aug 26, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Speeding up and reducing memory usage for scientific machine learning via mixed precision☆12Dec 27, 2024Updated last year
- including compiler to encode DGL GNN model to instructions, runtime software to transfer data and control the accelerator, and hardware v…☆15Nov 19, 2023Updated 2 years ago
- ☆13Oct 12, 2025Updated last year
- A really tiny autograd engine☆100May 26, 2025Updated last year
- Hypercube Viewer is a program that draws a hypercube of 3 to 10 dimensions.☆13Mar 30, 2025Updated last year
- [ICLR-2026 BlogPost] SVD via Accelerated Newton-Schulz Iteration☆13Apr 15, 2026Updated 7 months ago
- Implementation of FlashAttention (FA1-FA4) in PyTorch for educational and algorithmic clarity☆228Apr 12, 2026Updated 7 months ago
- High-Performance FP32 GEMM on CUDA devices☆131Jan 21, 2025Updated last year
- A 32-bit RISC-V Emulator in Rust☆10Feb 4, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Lion - EvoLved Sign Momentum w/ New Optimizer API in TensorFlow 2.11+☆10Feb 16, 2023Updated 3 years ago
- A Library That Uses Quantized Diffusion Model With Clustered Weights For Efficiently Generating More Image Datasets On-Device.☆14Jun 9, 2023Updated 3 years ago
- ☆17Nov 16, 2025Updated last year
- Fast text chunking algorithms for Python☆12Oct 7, 2020Updated 6 years ago
- Trained a 114 million Parameter LLM from Scratch.☆19Jul 21, 2024Updated 2 years ago
- ☆95Jul 5, 2024Updated 2 years ago
- Code Implementation for OSCAR 2026 Workshop: Toward Sustainable GPU Modeling: Autonomous Micro-benchmarking with LLM Agents☆17Jun 28, 2026Updated 4 months ago
- ☆12Aug 20, 2024Updated 2 years ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,346Aug 26, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆17Jul 4, 2026Updated 4 months ago
- ☆46May 4, 2025Updated last year
- The little simulator that could.☆25Nov 26, 2017Updated 8 years ago
- 100 days of building GPU kernels!☆638Apr 27, 2025Updated last year
- ☆15Mar 11, 2026Updated 8 months ago
- LLVM Tutorial☆14Nov 3, 2025Updated last year
- Fast GPU based tensor core reductions☆12Jan 13, 2023Updated 3 years ago
Are these results useful?