Distributed Training Over-The-Internet
☆1,069Oct 14, 2025Updated last year
Alternatives and similar repositories for DisTrO
Users that are interested in DisTrO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeMo: Decoupled Momentum Optimization☆202Dec 2, 2024Updated last year
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆510Sep 27, 2024Updated 2 years ago
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆610Jul 17, 2026Updated 4 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆1,362Jul 4, 2026Updated 4 months ago
- An open infrastructure to democratize and decentralize the development of superintelligence for humanity.☆983Mar 24, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- prime is a framework for efficient, globally distributed training of AI models over the internet.☆857Jul 17, 2026Updated 4 months ago
- ☆1,504Dec 22, 2025Updated 10 months ago
- Maybe the new state of the art vision model? we'll see 🤷♂️☆207Jan 10, 2024Updated 2 years ago
- ☆23Jan 5, 2025Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆3,434Nov 13, 2024Updated 2 years ago
- ☆132May 19, 2024Updated 2 years ago
- look how they massacred my boy☆63Oct 16, 2024Updated 2 years ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆165Sep 12, 2025Updated last year
- Modular Agentic AI Architecture - NousResearch x Teleport (Flashbots)☆107Jan 8, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation for MatMul-free LM.☆3,101Sep 6, 2026Updated 2 months ago
- Efficient Triton Kernels for LLM Training☆6,705Updated this week
- Go ahead and axolotl questions☆12,738Updated this week
- Generative Agents: Interactive Simulacra of Human Behavior - with Local LLMs☆29Aug 15, 2023Updated 3 years ago
- Incentivized Training over Wide Web with 1000x model compression.☆22Oct 30, 2024Updated 2 years ago
- Minimalistic large language model 3D-parallelism training☆10Feb 15, 2025Updated last year
- Tile primitives for speedy kernels☆3,803Sep 12, 2026Updated 2 months ago
- Tools for merging pretrained large language models.☆7,483Oct 31, 2026Updated 3 weeks ago
- NanoGPT (124M) in 90 seconds☆6,057Sep 28, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Minimalistic large language model 3D-parallelism training☆2,868Oct 8, 2026Updated last month
- Code for BLT research paper☆2,075Nov 3, 2025Updated last year
- Training LLMs with QLoRA + FSDP☆1,555Nov 9, 2024Updated 2 years ago
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,274Aug 22, 2025Updated last year
- PyTorch native post-training library☆5,819Updated this week
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,653Mar 4, 2026Updated 8 months ago
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆11May 23, 2025Updated last year
- Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"☆585Jun 28, 2024Updated 2 years ago
- GRadient-INformed MoE☆263Sep 25, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,786Nov 4, 2026Updated 2 weeks ago
- Tensor library for machine learning☆16,130Updated this week
- Simple demo showing how to use the Forge API by Nous Research☆18Nov 12, 2024Updated 2 years ago
- Schedule-Free Optimization in PyTorch☆2,335Jul 28, 2026Updated 3 months ago
- Run frontier AI locally.☆48,504Nov 6, 2026Updated 2 weeks ago
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,773Jul 18, 2025Updated last year
- You like pytorch? You like micrograd? You love tinygrad! ❤️☆33,954Updated this week
Are these results useful?