Alternatives and similar repositories for llmvm

Users that are interested in llmvm are comparing it to the libraries listed below

• cloneofsimo / zeroshampoo
  ☆33Updated 8 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• ClashLuke / SOAP
  ☆21Updated 6 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆100Updated 4 months ago
• EleutherAI / training-jacobian
  ☆21Updated 5 months ago
• srush / drop7
  ☆18Updated last year
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆32Updated 6 months ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated this week
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• catid / lllm
  Latent Large Language Models
  ☆18Updated 8 months ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆28Updated 4 years ago
• cloneofsimo / min-fsdp
  ☆79Updated 10 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 months ago
• okarthikb / state-space-models
  ☆27Updated 10 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆80Updated 5 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆60Updated 6 months ago
• sholtodouglas / scalingExperiments
  ☆59Updated 3 years ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆31Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆24Updated 2 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• GallagherCommaJack / modulax
  ☆17Updated 8 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 9 months ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 11 months ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆60Updated 3 years ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆55Updated this week
• google-deepmind / alta
  ☆22Updated 7 months ago