Alternatives and similar repositories for mup-vit

Users that are interested in mup-vit are comparing it to the libraries listed below

• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆38Updated 3 years ago
• shyamsn97 / hyper-nn
  Easy Hypernetworks in Pytorch and Jax
  ☆100Updated 2 years ago
• crowsonkb / cloob-training
  CLOOB training (JAX) and inference (JAX and PyTorch)
  ☆71Updated 3 years ago
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆27Updated 10 months ago
• GuillaumeLeclerc / fastargs
  Python library for argument and configuration management
  ☆54Updated 2 years ago
• HomebrewML / TrueGrad
  PyTorch interface for TrueGrad Optimizers
  ☆41Updated last year
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆106Updated 4 years ago
• crowsonkb / esgd
  ESGD-M is a stochastic non-convex second order optimizer, suitable for training deep learning models, for PyTorch.
  ☆56Updated 2 years ago
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆38Updated 3 years ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆81Updated 3 years ago
• cfoster0 / simple-diffusion-model
  Pedagogical codebase for a simplified score-based generative model design, with training loop
  ☆40Updated 3 years ago
• tgisaturday / dalle-lightning
  Refactoring dalle-pytorch and taming-transformers for TPU VM
  ☆60Updated 3 years ago
• cloneofsimo / insightful-nn-papers
  These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning
  ☆48Updated last year
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆77Updated 9 months ago
• cloneofsimo / karras-power-ema-tutorial
  ☆51Updated last year
• rom1504 / gpu-tester
  gpu tester detects broken and slow gpus in a cluster
  ☆70Updated 2 years ago
• cloneofsimo / zeroshampoo
  ☆33Updated 8 months ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• lucidrains / logavgexp-torch
  Implementation of LogAvgExp for Pytorch
  ☆36Updated last month
• pytorch / maskedtensor
  MaskedTensors for PyTorch
  ☆38Updated 2 years ago
• patil-suraj / stable-diffusion-jax
  ☆89Updated 2 years ago
• rom1504 / python-template
  Simple python template
  ☆41Updated last year
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆96Updated last month
• j10labs / wandview
  Mobile Viewer for W&B, built on top of Flutter.
  ☆34Updated last year
• cloneofsimo / efae
  ☆22Updated 11 months ago
• Zasder3 / open_clip_juwels
  An open source implementation of CLIP.
  ☆32Updated 2 years ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆80Updated 5 months ago
• HomebrewML / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆127Updated 2 years ago