minimal pytorch 4D parallelism
☆74Feb 16, 2026Updated 8 months ago
Alternatives and similar repositories for heiretsu
Users that are interested in heiretsu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Oct 10, 2025Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Apr 22, 2025Updated last year
- ☆13Nov 14, 2024Updated last year
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 7 months ago
- Dataset accompanying "PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data" (pu…☆14Dec 4, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Well documented examples of running distributed training jobs on Modal☆35Sep 25, 2026Updated last month
- ☆25May 23, 2025Updated last year
- rl from zero pretrain, can it be done? yes.☆297Sep 28, 2025Updated last year
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- [arXiv 2026] Learning from Rare Success and Rich Feedback via Reflection-Enhanced Self-Distillation☆20May 21, 2026Updated 5 months ago
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆31Feb 9, 2026Updated 8 months ago
- ☆265Nov 24, 2025Updated 11 months ago
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- Hand-Rolled GPU communications library☆95Nov 25, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880☆378Feb 17, 2026Updated 8 months ago
- Repository for GPU related kernels for learning/testing purposes☆21May 27, 2026Updated 5 months ago
- A simple C compiler I wrote to demonstrate how to write simple compilers. Currently targets x86_64☆31Jun 27, 2025Updated last year
- Minimal and highly hackable implementation of Looped Transformers with GPT☆26Mar 8, 2026Updated 7 months ago
- iMessage RAG MCP Server from Anthropic MCP Hackathon (NYC)☆15Mar 10, 2025Updated last year
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆124Feb 28, 2026Updated 8 months ago
- Course on Flash-attention in Triton☆103Feb 9, 2026Updated 8 months ago
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 8 months ago
- a fun and educational take on vLLM☆231Jan 25, 2026Updated 9 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆25Jan 28, 2026Updated 9 months ago
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆34May 29, 2023Updated 3 years ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,335Aug 26, 2025Updated last year
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆258Updated this week
- XmodelLM☆38Nov 19, 2024Updated last year
- Multilingual Document Layout Parsing in a Single Vision-Language Model☆59Aug 6, 2025Updated last year
- token☆13Jan 23, 2023Updated 3 years ago
- WhaleSearch 🐳 - semantic search engine. (SSE)☆16Jan 4, 2025Updated last year
- ☆13Apr 16, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆20Apr 18, 2026Updated 6 months ago
- Tensor-Slayer : Manipulate weights and tensors of LLMs to achieve performance upgrades and introduce a novel inferenceless mechanistic in…☆28May 27, 2025Updated last year
- RL models to play Sokoban. The fastest recipe wins.☆35Oct 18, 2026Updated last week
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- ☆92Mar 23, 2026Updated 7 months ago
- /goal port from codex to arbitrary agents and harnesses, opencode, claude code, etc☆12May 16, 2026Updated 5 months ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year