Alternatives and similar repositories for diloco-sim:

Users that are interested in diloco-sim are comparing it to the libraries listed below

• google-deepmind / asyncdiloco
  ☆42Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 weeks ago
• xjdr-alt / muzero_sketch
  ☆38Updated 6 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 4 months ago
• okarthikb / state-space-models
  ☆27Updated 7 months ago
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated 4 months ago
• doomslide / autoloom
  ☆20Updated 3 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 2 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆95Updated 3 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 3 weeks ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated 11 months ago
• google-deepmind / alta
  ☆21Updated 4 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆27Updated this week
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆24Updated 8 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated last month
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆39Updated 3 weeks ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆30Updated 3 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆31Updated this week
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 4 months ago
• arcee-ai / DAM
  ☆48Updated 3 months ago
• katiekang1998 / reasoning_generalization
  ☆26Updated last month