Alternatives and similar repositories for stable-pretraining

Users that are interested in stable-pretraining are comparing it to the libraries listed below

• autonomousvision / akorn
  [ICLR'25] Artificial Kuramoto Oscillatory Neurons
  ☆106Updated 2 months ago
• BlackHC / neural_net_checklist
  ☆212Updated last year
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆340Updated last month
• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆331Updated 5 months ago
• google-deepmind / nanodo
  ☆287Updated last year
• mila-iqia / ResearchTemplate
  Research Project Template Repository
  ☆38Updated 3 weeks ago
• TorchJD / torchjd
  Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning)…
  ☆291Updated last week
• modula-systems / modula
  🧱 Modula software package
  ☆322Updated 4 months ago
• BARL-SSL / reptrix
  Library that provides metrics to assess representation quality
  ☆20Updated 11 months ago
• KempnerInstitute / overcomplete
  👋 Overcomplete is a Vision-based SAE Toolbox
  ☆112Updated last month
• lindermanlab / S5
  ☆313Updated last year
• nikhilvyas / SOAP
  ☆234Updated last year
• NX-AI / xlstm-jax
  Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…
  ☆105Updated last year
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• eemlcommunity / PracticalSessions2023
  ☆69Updated 2 years ago
• Niccolo-Ajroldi / plainLM
  Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…
  ☆42Updated 3 weeks ago
• kvfrans / splus
  ☆122Updated 6 months ago
• CLAIRE-Labo / python-ml-research-template
  A template for starting reproducible Python machine-learning projects with hardware acceleration. Find an example at https://github.com/C…
  ☆113Updated 7 months ago
• willisma / diffuse_nnx
  A comprehensive JAX/NNX library for diffusion and flow matching generative algorithms, featuring DiT (Diffusion Transformer) and its vari…
  ☆125Updated 2 months ago
• team-approx-bayes / ivon
  IVON optimizer for neural networks based on variational learning.
  ☆80Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated 2 weeks ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆128Updated last year
• locuslab / torchdeq
  Modern Fixed Point Systems using Pytorch
  ☆125Updated 2 years ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆300Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆37Updated 3 years ago
• facebookresearch / capi
  Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"
  ☆125Updated 3 weeks ago
• AllanYangZhou / nfn
  NF-Layers for constructing neural functionals.
  ☆93Updated 2 years ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆510Updated 6 months ago
• riverstone496 / awesome-second-order-optimization
  ☆27Updated 3 months ago
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆280Updated 2 weeks ago