minimal pytorch 4D parallelism
☆74Feb 16, 2026Updated 9 months ago
Alternatives and similar repositories for heiretsu
Users that are interested in heiretsu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LM/VLM implementations☆12Oct 13, 2026Updated last month
- ☆25Oct 10, 2025Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Apr 22, 2025Updated last year
- ☆13Nov 14, 2024Updated 2 years ago
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Dataset accompanying "PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data" (pu…☆14Dec 4, 2024Updated last year
- A utility script to upload pytorch traces to a Hugging Face Bucket, and then build sharable trace URL☆11Jun 23, 2026Updated 4 months ago
- Well documented examples of running distributed training jobs on Modal☆35Sep 25, 2026Updated last month
- ☆47May 24, 2025Updated last year
- ☆25May 23, 2025Updated last year
- observability for speculative decoding☆15Aug 23, 2026Updated 2 months ago
- Instant Neural Graphics Primitives from scratch, zero dependencies. Learning by doing.☆10Aug 18, 2023Updated 3 years ago
- Tenyson: Run multi-step Unsloth research (SFT, RL, eval) from two Python files. Chain runs linearly or in parallel. Training, cloud runne…☆14Apr 19, 2026Updated 7 months ago
- rl from zero pretrain, can it be done? yes.☆297Sep 28, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- Hand-Rolled GPU communications library☆95Nov 25, 2025Updated 11 months ago
- ☆267Nov 24, 2025Updated 11 months ago
- implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880☆382Feb 17, 2026Updated 9 months ago
- [arXiv 2026] Learning from Rare Success and Rich Feedback via Reflection-Enhanced Self-Distillation☆20May 21, 2026Updated 5 months ago
- A simple C compiler I wrote to demonstrate how to write simple compilers. Currently targets x86_64☆31Jun 27, 2025Updated last year
- iMessage RAG MCP Server from Anthropic MCP Hackathon (NYC)☆15Mar 10, 2025Updated last year
- Repository for GPU related kernels for learning/testing purposes☆21May 27, 2026Updated 5 months ago
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆125Feb 28, 2026Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Course on Flash-attention in Triton☆103Feb 9, 2026Updated 9 months ago
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆21Jan 30, 2026Updated 9 months ago
- A framework for few-shot evaluation of autoregressive language models.☆16Aug 23, 2023Updated 3 years ago
- a fun and educational take on vLLM☆232Jan 25, 2026Updated 9 months ago
- Tiny-Megatron, a minimalistic re-implementation of the Megatron library☆31Sep 1, 2025Updated last year
- ☆25Jan 28, 2026Updated 9 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆34May 29, 2023Updated 3 years ago
- ☆12Nov 10, 2025Updated last year
- Inline PTX Assembly in CUDA example☆15Oct 5, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,346Aug 26, 2025Updated last year
- ☆13Apr 16, 2025Updated last year
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆258Updated this week
- Use Muon optimizer instead of AdamW.☆51Mar 2, 2026Updated 8 months ago
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆20Apr 18, 2026Updated 7 months ago
- RL models to play Sokoban. The fastest recipe wins.☆35Oct 18, 2026Updated last month
- The best ChatGPT that $100 can buy.☆61Updated this week
Are these results useful?