Alternatives and similar repositories for DisTrO

Users that are interested in DisTrO are comparing it to the libraries listed below

• PrimeIntellect-ai / prime-diloco
  prime is a framework for efficient, globally distributed training of AI models over the internet.
  ☆850Updated 2 months ago
• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆561Updated last year
• NousResearch / atropos
  Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …
  ☆843Updated this week
• PrimeIntellect-ai / prime-rl
  Async RL Training at Scale
  ☆1,020Updated this week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆661Updated this week
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆941Updated 2 months ago
• cartesia-ai / edge
  On-device intelligence.
  ☆393Updated 10 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆829Updated 5 months ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,182Updated 11 months ago
• xjdr-alt / entropix-local
  smol models are fun too
  ☆93Updated last year
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆674Updated 9 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆345Updated last year
• apoorvumang / prompt-lookup-decoding
  ☆591Updated last year
• tinygrad / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆1,313Updated 7 months ago
• PsycheFoundation / psyche
  An open infrastructure to democratize and decentralize the development of superintelligence for humanity.
  ☆577Updated this week
• wbrickner / noise_step
  noise_step: Training in 1.58b With No Gradient Memory
  ☆220Updated last year
• dropbox / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆907Updated last month
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆457Updated last year
• aidanmclaughlin / AidanBench
  Aidan Bench attempts to measure <big_model_smell> in LLMs.
  ☆315Updated 7 months ago
• mistralai / mistral-common
  Official inference library for pre-processing of Mistral models
  ☆846Updated this week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆243Updated last year
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆336Updated last week
• mistralai / megablocks-public
  ☆866Updated 2 years ago
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆628Updated 10 months ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆859Updated 3 weeks ago
• pranavjad / mlx-gpt2
  gpt-2 from scratch in mlx
  ☆414Updated last year
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆570Updated last year
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆225Updated 10 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆370Updated last year
• NeoVertex1 / ComplexTensor
  ComplexTensor: Machine Learning By Bridging Classical and Quantum Computation
  ☆78Updated last year