Alternatives and similar repositories for stable-pretraining

Users that are interested in stable-pretraining are comparing it to the libraries listed below

• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆309Updated 2 months ago
• kvfrans / splus
  ☆120Updated 3 months ago
• google-deepmind / nanodo
  ☆281Updated last year
• autonomousvision / akorn
  [ICLR'25] Artificial Kuramoto Oscillatory Neurons
  ☆102Updated last month
• BlackHC / neural_net_checklist
  ☆150Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆239Updated last month
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆301Updated 2 months ago
• locuslab / torchdeq
  Modern Fixed Point Systems using Pytorch
  ☆115Updated last year
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆291Updated last year
• CLAIRE-Labo / python-ml-research-template
  A template for starting reproducible Python machine-learning projects with hardware acceleration. Find an example at https://github.com/C…
  ☆106Updated 3 months ago
• nikhilvyas / SOAP
  ☆214Updated 9 months ago
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆261Updated this week
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated last year
• mila-iqia / ResearchTemplate
  Research Project Template Repository
  ☆34Updated last month
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆84Updated 9 months ago
• lindermanlab / elk
  Scalable and Stable Parallelization of Nonlinear RNNS
  ☆22Updated 3 weeks ago
• NX-AI / xlstm-jax
  Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…
  ☆103Updated 8 months ago
• TorchJD / torchjd
  Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning)…
  ☆270Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆164Updated 3 months ago
• clement-bonnet / lpn
  Latent Program Network (from the "Searching Latent Program Spaces" paper)
  ☆98Updated 6 months ago
• kvfrans / jax-flow
  Flow-matching algorithms in JAX
  ☆104Updated last year
• klieret / wandb-offline-sync-hook
  A convenient way to trigger synchronizations to wandb / Weights & Biases if your compute nodes don't have internet!
  ☆85Updated 3 weeks ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆502Updated 3 months ago
• marin-community / marin
  Open-source framework for the research and development of foundation models.
  ☆452Updated this week
• shikaiqiu / compute-better-spent
  ☆58Updated 11 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆490Updated last year
• Algomancer / Bayesian-Flow-Networks
  A simple implimentation of Bayesian Flow Networks (BFN)
  ☆240Updated last year
• facebookresearch / capi
  Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"
  ☆120Updated 5 months ago
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆34Updated 8 months ago
• riverstone496 / awesome-second-order-optimization
  ☆27Updated last year