Alternatives and similar repositories for DisTrO:

Users that are interested in DisTrO are comparing it to the libraries listed below

• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆424Updated 2 weeks ago
• PrimeIntellect-ai / prime
  prime is a framework for efficient, globally distributed training of AI models over the internet.
  ☆626Updated this week
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆801Updated last week
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆569Updated last week
• wbrickner / noise_step
  noise_step: Training in 1.58b With No Gradient Memory
  ☆214Updated last month
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆735Updated this week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆614Updated 6 months ago
• codelion / optillm
  Optimizing inference proxy for LLMs
  ☆1,955Updated this week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆971Updated last week
• bespokelabsai / curator
  Synthetic Data curation for post-training and structured data extraction
  ☆539Updated this week
• tinygrad / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆993Updated last month
• volcengine / verl
  veRL: Volcano Engine Reinforcement Learning for LLM
  ☆1,135Updated this week
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆736Updated 2 weeks ago
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆670Updated this week
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆833Updated last week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,400Updated this week
• arcprizeorg / model_baseline
  Testing baseline LLMs performance across various models
  ☆211Updated this week
• kvcache-ai / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆845Updated 2 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆394Updated 4 months ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,300Updated 5 months ago
• NVIDIA / RULER
  This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
  ☆866Updated last month
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆280Updated 3 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆881Updated this week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,966Updated this week
• apoorvumang / prompt-lookup-decoding
  ☆497Updated 5 months ago
• NousResearch / Hermes-Function-Calling
  ☆780Updated 4 months ago
• huggingface / smollm
  Everything about the SmolLM2 and SmolVLM family of models
  ☆1,632Updated this week
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆261Updated 4 months ago
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆605Updated 2 months ago
• facebookresearch / blt
  Code for BLT research paper
  ☆1,352Updated this week