minimal pytorch 4D parallelism
☆73Feb 16, 2026Updated 6 months ago
Alternatives and similar repositories for heiretsu
Users that are interested in heiretsu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Oct 10, 2025Updated 10 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Apr 22, 2025Updated last year
- MoE training for Me and You and maybe other people☆396Mar 15, 2026Updated 5 months ago
- Well documented examples of running distributed training jobs on Modal☆33Aug 11, 2026Updated 2 weeks ago
- ☆46May 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆28Feb 9, 2026Updated 6 months ago
- ☆25May 23, 2025Updated last year
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 3 years ago
- a fun and educational take on vLLM☆222Jan 25, 2026Updated 7 months ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Repository for GPU related kernels for learning/testing purposes☆21May 27, 2026Updated 3 months ago
- rl from zero pretrain, can it be done? yes.☆296Sep 28, 2025Updated 11 months ago
- Hand-Rolled GPU communications library☆96Nov 25, 2025Updated 9 months ago
- Program that produces retail/wholesale trade statistics using machine learning + visualisations☆17Aug 21, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Minimal and highly hackable implementation of Looped Transformers with GPT☆25Mar 8, 2026Updated 5 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆33May 29, 2023Updated 3 years ago
- An educational distributed training and inference library for neural nets using local computing☆77Jun 10, 2026Updated 2 months ago
- RL models to play Sokoban. The fastest recipe wins.☆31Jul 25, 2026Updated last month
- implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880☆375Feb 17, 2026Updated 6 months ago
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆249Aug 20, 2026Updated last week
- XmodelLM☆38Nov 19, 2024Updated last year
- ☆25Jan 28, 2026Updated 7 months ago
- ☆258Nov 24, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆19Apr 18, 2026Updated 4 months ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
- Use Muon optimizer instead of AdamW.☆50Mar 2, 2026Updated 5 months ago
- WhaleSearch 🐳 - semantic search engine. (SSE)☆16Jan 4, 2025Updated last year
- Tensor-Slayer : Manipulate weights and tensors of LLMs to achieve performance upgrades and introduce a novel inferenceless mechanistic in…☆28May 27, 2025Updated last year
- ☆32Nov 4, 2024Updated last year
- ☆13Apr 16, 2025Updated last year
- UCSD ECE277 GPU Programming coursework: GPU-accelerated reinforcement learning on CUDA C with Nsight System☆14Aug 17, 2021Updated 5 years ago
- An unofficial Github Copilot extension for Lapce☆15Mar 12, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,292Aug 26, 2025Updated last year
- 100M tokens. Infinite compute. Lowest val loss wins.☆529Jul 3, 2026Updated last month
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆4,907May 17, 2026Updated 3 months ago
- a LLM inference engine to run on consumer hardware☆47Apr 15, 2026Updated 4 months ago
- Ludic – an LLM-RL library for the era of experience☆67Aug 9, 2026Updated 3 weeks ago
- a personal collection of my notes for ml sys☆122Aug 8, 2026Updated 3 weeks ago
- a whirlwind tour to deep learning and deep learning systems☆82Updated this week