Alternatives and similar repositories for diloco-sim:

Users that are interested in diloco-sim are comparing it to the libraries listed below

• google-deepmind / asyncdiloco
  ☆43Updated last year
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆37Updated last month
• okarthikb / state-space-models
  ☆27Updated 8 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 8 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 5 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆91Updated 3 weeks ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated last month
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last week
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• apple / ml-planner
  ☆45Updated last year
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆43Updated 7 months ago
• open-thought / reasoning-gym-eval
  Collection of LLM completions for reasoning-gym task datasets
  ☆15Updated this week
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated last month
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆85Updated last week
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated 5 months ago
• EleutherAI / steering-llama3
  ☆26Updated 7 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆33Updated last week
• EleutherAI / training-jacobian
  ☆21Updated 3 months ago
• RobertCsordas / moeut
  ☆74Updated 7 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆103Updated 4 months ago
• doomslide / autoloom
  ☆20Updated 4 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 6 months ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 3 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆42Updated 6 months ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆25Updated 9 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated 11 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 7 months ago
• Phylliida / MambaLens
  Mamba support for transformer lens
  ☆14Updated 6 months ago