Alternatives and similar repositories for diloco-sim

Users that are interested in diloco-sim are comparing it to the libraries listed below

• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆44Updated last year
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 8 months ago
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆45Updated 2 months ago
• PrimeIntellect-ai / prime-vllm
  Modded vLLM to run pipeline parallelism over public networks
  ☆37Updated last month
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 3 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆94Updated last month
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated 8 months ago
• open-thought / reasoning-gym-eval
  Collection of LLM completions for reasoning-gym task datasets
  ☆24Updated last month
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• okarthikb / state-space-models
  ☆27Updated 11 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆188Updated 6 months ago
• PrimeIntellect-ai / smart-contracts
  Solidity contracts for the decentralized Prime Network protocol
  ☆23Updated last week
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆36Updated 3 weeks ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 6 months ago
• brendanhogan / picoDeepResearch
  ☆63Updated last month
• RobertCsordas / moeut
  ☆79Updated 10 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 9 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated 3 weeks ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆80Updated 2 weeks ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆66Updated 2 months ago
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• vicksEmmanuel / latent-gemma
  ☆26Updated 5 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆44Updated 9 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆63Updated 7 months ago
• xjdr-alt / entropix-trainer
  train entropix like a champ!
  ☆20Updated 8 months ago