prime is a framework for efficient, globally distributed training of AI models over the internet.
☆851Nov 16, 2025Updated 3 months ago
Alternatives and similar repositories for prime-diloco
Users that are interested in prime-diloco are comparing it to the libraries listed below
Sorting:
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆562Jan 13, 2025Updated last year
- Solidity contracts for the decentralized Prime Network protocol☆26Jul 6, 2025Updated 7 months ago
- Async RL Training at Scale☆1,096Updated this week
- Distributed Training Over-The-Internet☆978Oct 14, 2025Updated 4 months ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆143Sep 12, 2025Updated 5 months ago
- peer-to-peer compute and intelligence network that enables decentralized AI development at scale☆137Nov 10, 2025Updated 3 months ago
- Modded vLLM to run pipeline parallelism over public networks☆40May 20, 2025Updated 9 months ago
- ☆34Sep 10, 2024Updated last year
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆42Jun 9, 2025Updated 8 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Jun 3, 2024Updated last year
- Minimalistic large language model 3D-parallelism training☆2,579Feb 19, 2026Updated last week
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆52Apr 14, 2025Updated 10 months ago
- Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.☆2,390Jan 11, 2026Updated last month
- Efficient Triton Kernels for LLM Training☆6,162Updated this week
- Pretraining Code for METAGENE-1☆68Jan 6, 2025Updated last year
- AllenAI's post-training codebase☆3,592Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆478Feb 3, 2026Updated 3 weeks ago
- A PyTorch native platform for training generative AI models☆5,098Updated this week
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,752Jul 18, 2025Updated 7 months ago
- supporting pytorch FSDP for optimizers☆84Dec 8, 2024Updated last year
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆251Jan 31, 2025Updated last year
- An Open Source Toolkit For LLM Distillation☆875Dec 21, 2025Updated 2 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,090Aug 26, 2025Updated 6 months ago
- Tools for merging pretrained large language models.☆6,814Jan 26, 2026Updated last month
- Entropy Based Sampling and Parallel CoT Decoding☆3,434Nov 13, 2024Updated last year
- PyTorch native quantization and sparsity for training and inference☆2,707Updated this week
- Code for BLT research paper☆2,029Nov 3, 2025Updated 3 months ago
- GRadient-INformed MoE☆264Sep 25, 2024Updated last year
- SGLang is a high-performance serving framework for large language models and multimodal models.☆23,905Updated this week
- Ring attention implementation with flash attention☆986Sep 10, 2025Updated 5 months ago
- The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention☆3,347Jul 7, 2025Updated 7 months ago
- FlashInfer: Kernel Library for LLM Serving☆5,009Feb 23, 2026Updated last week
- This repository contains the experimental PyTorch native float8 training UX☆226Aug 1, 2024Updated last year
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆872Updated this week
- Codebase for Aria - an Open Multimodal Native MoE☆1,082Jan 22, 2025Updated last year
- Sky-T1: Train your own O1 preview model within $450☆3,369Jul 12, 2025Updated 7 months ago
- Go ahead and axolotl questions☆11,335Updated this week
- ☆137Mar 20, 2025Updated 11 months ago
- Modeling, training, eval, and inference code for OLMo☆6,326Nov 24, 2025Updated 3 months ago