PrimeIntellect-ai / prime-dilocoLinks
prime is a framework for efficient, globally distributed training of AI models over the internet.
☆849Updated 5 months ago
Alternatives and similar repositories for prime-diloco
Users that are interested in prime-diloco are comparing it to the libraries listed below
Sorting:
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆546Updated 10 months ago
- Async RL Training at Scale☆749Updated last week
- Distributed Training Over-The-Internet☆963Updated last month
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆743Updated this week
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆820Updated this week
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,214Updated last month
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆355Updated 11 months ago
- ☆894Updated last week
- OLMoE: Open Mixture-of-Experts Language Models☆901Updated last month
- Minimalistic large language model 3D-parallelism training☆2,311Updated 2 months ago
- Muon is Scalable for LLM Training☆1,354Updated 3 months ago
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆663Updated 6 months ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,162Updated 9 months ago
- Scalable toolkit for efficient model reinforcement☆1,024Updated this week
- Pretraining and inference code for a large-scale depth-recurrent language model☆843Updated 3 weeks ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆926Updated 2 weeks ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,892Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,117Updated 5 months ago
- An Open Source Toolkit For LLM Distillation☆777Updated 4 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆556Updated last month
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA (+ more DSLs)☆655Updated this week
- System 2 Reasoning Link Collection☆855Updated 7 months ago
- ☆575Updated last year
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆302Updated last week
- Serverless LLM Serving for Everyone.☆585Updated this week
- Efficient LLM Inference over Long Sequences☆390Updated 4 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,170Updated this week
- PyTorch-native post-training at scale☆509Updated this week
- Post-training with Tinker☆1,932Updated this week
- PyTorch Single Controller☆883Updated this week