PrimeIntellect-ai / prime-dilocoLinks
prime is a framework for efficient, globally distributed training of AI models over the internet.
☆850Updated 2 weeks ago
Alternatives and similar repositories for prime-diloco
Users that are interested in prime-diloco are comparing it to the libraries listed below
Sorting:
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆550Updated 10 months ago
- Distributed Training Over-The-Internet☆966Updated last month
- Async RL Training at Scale☆867Updated this week
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆760Updated this week
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆668Updated 7 months ago
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆851Updated last week
- ☆917Updated last month
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆360Updated 11 months ago
- An Open Source Toolkit For LLM Distillation☆785Updated 4 months ago
- Muon is Scalable for LLM Training☆1,372Updated 4 months ago
- Minimalistic large language model 3D-parallelism training☆2,351Updated 2 weeks ago
- ☆581Updated last year
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,172Updated 10 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,911Updated 3 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆919Updated 2 months ago
- Advanced quantization toolkit for LLMs and VLMs. Native support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Bits and seamless integration with …☆735Updated this week
- Official implementation of Half-Quadratic Quantization (HQQ)☆894Updated last month
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆932Updated 2 weeks ago
- Pretraining and inference code for a large-scale depth-recurrent language model☆850Updated last month
- Efficient LLM Inference over Long Sequences☆392Updated 5 months ago
- PyTorch building blocks for the OLMo ecosystem☆482Updated this week
- Recipes to scale inference-time compute of open models☆1,118Updated 6 months ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,242Updated 3 weeks ago
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆2,296Updated this week
- PyTorch-native post-training at scale☆549Updated last week
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆329Updated last year
- A throughput-oriented high-performance serving framework for LLMs☆918Updated last month
- Fast, Flexible and Portable Structured Generation☆1,396Updated last week
- LLM KV cache compression made easy☆701Updated this week
- On-device intelligence.☆391Updated 8 months ago