Alternatives and similar repositories for stable-pretraining

Users that are interested in stable-pretraining are comparing it to the libraries listed below

• autonomousvision / akorn
  [ICLR'25] Artificial Kuramoto Oscillatory Neurons
  ☆103Updated 2 months ago
• CLAIRE-Labo / python-ml-research-template
  A template for starting reproducible Python machine-learning projects with hardware acceleration. Find an example at https://github.com/C…
  ☆109Updated 4 months ago
• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆311Updated 2 months ago
• BlackHC / neural_net_checklist
  ☆150Updated last year
• TorchJD / torchjd
  Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning)…
  ☆271Updated this week
• google-deepmind / nanodo
  ☆283Updated last year
• kvfrans / splus
  ☆120Updated 4 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆287Updated 2 months ago
• lucmos / relreps
  Relative representations can be leveraged to enable solving tasks regarding "latent communication": from zero-shot model stitching to lat…
  ☆63Updated 2 years ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆293Updated last year
• nikhilvyas / SOAP
  ☆217Updated 10 months ago
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆313Updated 3 months ago
• mila-iqia / ResearchTemplate
  Research Project Template Repository
  ☆34Updated last month
• elyall / wandb_on_slurm
  Example of how to use Weights & Biases on Slurm
  ☆118Updated 3 years ago
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆269Updated last week
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated last year
• AllanYangZhou / nfn
  NF-Layers for constructing neural functionals.
  ☆90Updated last year
• lindermanlab / elk
  Scalable and Stable Parallelization of Nonlinear RNNS
  ☆23Updated last week
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆124Updated last year
• tristandeleu / gfn-maxent-rl
  Comparison between GFlowNets & Maximum Entropy RL
  ☆19Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆166Updated 3 months ago
• loeweX / RotatingFeatures
  Code for the paper: Rotating Features for Object Discovery
  ☆53Updated last year
• clement-bonnet / lpn
  Latent Program Network (from the "Searching Latent Program Spaces" paper)
  ☆98Updated 2 weeks ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆35Updated 3 years ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆503Updated 3 months ago
• kvfrans / jax-flow
  Flow-matching algorithms in JAX
  ☆105Updated last year
• facebookresearch / capi
  Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"
  ☆122Updated 6 months ago
• BARL-SSL / reptrix
  Library that provides metrics to assess representation quality
  ☆16Updated 8 months ago
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆369Updated 2 years ago
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆77Updated 3 weeks ago