PrimeIntellect-ai / prime-dilocoLinks
prime is a framework for efficient, globally distributed training of AI models over the internet.
☆849Updated last month
Alternatives and similar repositories for prime-diloco
Users that are interested in prime-diloco are comparing it to the libraries listed below
Sorting:
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆554Updated 11 months ago
- Distributed Training Over-The-Internet☆973Updated 2 months ago
- Async RL Training at Scale☆950Updated this week
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆780Updated this week
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆871Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆362Updated last year
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,923Updated 4 months ago
- Muon is Scalable for LLM Training☆1,387Updated 4 months ago
- ☆941Updated last month
- Pretraining and inference code for a large-scale depth-recurrent language model☆856Updated 2 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆930Updated 3 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆933Updated last month
- PyTorch building blocks for the OLMo ecosystem☆612Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆459Updated 2 weeks ago
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,177Updated 10 months ago
- Minimalistic large language model 3D-parallelism training☆2,381Updated 2 weeks ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,283Updated last week
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆670Updated 8 months ago
- Scalable toolkit for efficient model reinforcement☆1,141Updated last week
- Efficient LLM Inference over Long Sequences☆394Updated 6 months ago
- An Open Source Toolkit For LLM Distillation☆810Updated this week
- Recipes to scale inference-time compute of open models☆1,120Updated 7 months ago
- LLM KV cache compression made easy☆729Updated last week
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆569Updated 2 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆327Updated last month
- Testing baseline LLMs performance across various models☆330Updated 3 weeks ago
- noise_step: Training in 1.58b With No Gradient Memory☆221Updated last year
- Advanced quantization toolkit for LLMs and VLMs. Support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Schemes and seamless integration with Tra…☆775Updated this week
- Where GPUs get cooked 👩🍳🔥☆339Updated 3 months ago
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆343Updated last year