Alternatives and similar repositories for DisTrO

Users that are interested in DisTrO are comparing it to the libraries listed below

• PrimeIntellect-ai / prime
  prime is a framework for efficient, globally distributed training of AI models over the internet.
  ☆820Updated 3 months ago
• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆530Updated 8 months ago
• NousResearch / atropos
  Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …
  ☆692Updated this week
• PrimeIntellect-ai / prime-rl
  Decentralized RL Training at Scale
  ☆592Updated this week
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆909Updated 4 months ago
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆651Updated 3 months ago
• mistralai / megablocks-public
  ☆866Updated last year
• wbrickner / noise_step
  noise_step: Training in 1.58b With No Gradient Memory
  ☆221Updated 8 months ago
• mistralai / mistral-common
  Official inference library for pre-processing of Mistral models
  ☆793Updated this week
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆813Updated last month
• aidanmclaughlin / AidanBench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆313Updated 2 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆450Updated 11 months ago
• open-thought / reasoning-gym
  procedural reasoning datasets
  ☆1,102Updated this week
• FailSpy / abliterator
  Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens
  ☆507Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆217Updated last year
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆852Updated 6 months ago
• xjdr-alt / entropix-local
  smol models are fun too
  ☆93Updated 10 months ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,145Updated 7 months ago
• vgel / repeng
  A library for making RepE control vectors
  ☆636Updated 8 months ago
• PsycheFoundation / psyche
  An open infrastructure to democratize and decentralize the development of superintelligence for humanity.
  ☆474Updated this week
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆827Updated 2 weeks ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆878Updated 2 weeks ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆655Updated 4 months ago
• mistralai-sf24 / hackathon
  ☆447Updated last year
• Lightning-AI / lightning-thunder
  PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…
  ☆1,411Updated this week
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆221Updated 6 months ago
• cartesia-ai / edge
  On-device intelligence.
  ☆376Updated 5 months ago
• apoorvumang / prompt-lookup-decoding
  ☆566Updated last year
• NousResearch / Hermes-Function-Calling
  ☆1,077Updated last year
• xjdr-alt / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆3,421Updated 10 months ago