PrimeIntellect-ai / prime
prime is a framework for efficient, globally distributed training of AI models over the internet.
☆708Updated this week
Alternatives and similar repositories for prime:
Users that are interested in prime are comparing it to the libraries listed below
- OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training☆487Updated 3 months ago
- Distributed Training Over-The-Internet☆902Updated 4 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆991Updated last month
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆320Updated 4 months ago
- Pretraining code for a large-scale depth-recurrent language model☆745Updated last week
- Muon is Scalable for LLM Training☆1,029Updated 3 weeks ago
- OLMoE: Open Mixture-of-Experts Language Models☆716Updated last month
- Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆509Updated last month
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆628Updated 3 weeks ago
- Training Large Language Model to Reason in a Continuous Latent Space☆1,076Updated 3 months ago
- Efficient LLM Inference over Long Sequences☆370Updated this week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,043Updated 2 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆865Updated 2 months ago
- Minimalistic large language model 3D-parallelism training☆1,808Updated this week
- Recipes to scale inference-time compute of open models☆1,058Updated 2 months ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆484Updated 2 weeks ago
- An Open Source Toolkit For LLM Distillation☆579Updated 3 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,438Updated last week
- A throughput-oriented high-performance serving framework for LLMs☆797Updated 7 months ago
- An Open Large Reasoning Model for Real-World Solutions☆1,483Updated last month
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆419Updated 2 weeks ago
- System 2 Reasoning Link Collection☆826Updated last month
- [NeurIPS'24 Spotlight, ICLR'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which r…☆971Updated last week
- Fast, Flexible and Portable Structured Generation☆888Updated 2 weeks ago
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆1,251Updated this week
- Build your own visual reasoning model☆341Updated this week
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,171Updated 2 weeks ago
- procedural reasoning datasets☆571Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆277Updated this week
- Scalable RL solution for advanced reasoning of language models☆1,504Updated last month