OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
☆600Jul 17, 2026Updated 3 months ago
Alternatives and similar repositories for OpenDiloco
Users that are interested in OpenDiloco are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- prime is a framework for efficient, globally distributed training of AI models over the internet.☆856Jul 17, 2026Updated 3 months ago
- torch implementation of diloco☆30Jul 17, 2026Updated 3 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆164Sep 12, 2025Updated last year
- ☆51Jan 18, 2024Updated 2 years ago
- peer-to-peer compute and intelligence network that enables decentralized AI development at scale☆140Nov 10, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distributed Training Over-The-Internet☆1,066Oct 14, 2025Updated last year
- Solidity contracts for the decentralized Prime Network protocol☆26Jul 6, 2025Updated last year
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 7 months ago
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆54Jul 28, 2026Updated 3 months ago
- ☆139Mar 20, 2025Updated last year
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆63Sep 4, 2026Updated last month
- Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"☆151Dec 11, 2023Updated 2 years ago
- Modded vLLM to run pipeline parallelism over public networks☆42May 20, 2025Updated last year
- Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrast…☆341Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- DeMo: Decoupled Momentum Optimization☆202Dec 2, 2024Updated last year
- Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.☆2,547Jan 11, 2026Updated 9 months ago
- Minimalistic large language model 3D-parallelism training☆2,850Oct 8, 2026Updated 3 weeks ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆552Updated this week
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆137Dec 3, 2024Updated last year
- A 7B parameter model for mathematical reasoning☆45Aug 9, 2026Updated 2 months ago
- Real-time terminal monitor for InfiniBand networks - htop for high-speed interconnects☆142Sep 3, 2026Updated last month
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Nov 18, 2025Updated 11 months ago
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Experimental repository for research implementation of NoLoCo.☆31Mar 26, 2026Updated 7 months ago
- CCLoco: Scaling Up Top-K Error Feedback with Local Optimizers☆29Aug 22, 2025Updated last year
- A PyTorch native platform for training generative AI models☆5,858Updated this week
- ☆1,600Mar 25, 2026Updated 7 months ago
- Agentic RL Training at Scale☆2,203Updated this week
- Tools for merging pretrained large language models.☆7,421Oct 22, 2026Updated last week
- An Open Source Toolkit For LLM Distillation☆1,087May 12, 2026Updated 5 months ago
- Efficient Triton Kernels for LLM Training☆6,678Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆386Dec 12, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,335Aug 26, 2025Updated last year
- ☆33Sep 10, 2024Updated 2 years ago
- SIMD quantization kernels☆93May 29, 2026Updated 5 months ago
- PyTorch native quantization for training and inference☆3,018Updated this week
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 7 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆1,359Jul 4, 2026Updated 3 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆207Jul 17, 2024Updated 2 years ago