Alternatives and similar repositories for SLIDE_opt_ia

Users that are interested in SLIDE_opt_ia are comparing it to the libraries listed below

• nestordemeure / flaxOptimizers
  A collection of optimizers, some arcane others well known, for Flax.
  ☆29Updated 3 years ago
• RUSH-LAB / SLIDE
  ☆471Updated 3 years ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆239Updated 2 years ago
• shawwn / ml-notes
  ☆39Updated 2 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 3 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated 2 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• Hoff97 / tensorjs
  Deep learning for the Web
  ☆38Updated 4 years ago
• jxbz / nero
  👑 Pytorch code for the Nero optimiser.
  ☆20Updated 2 years ago
• r0mainK / outperformer
  Code for scaling Transformers
  ☆26Updated 4 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• NTT123 / pax
  A stateful pytree library for training neural networks.
  ☆22Updated 2 years ago
• yifding / hetseq
  HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
  ☆106Updated last year
• jxbz / madam
  👩 Pytorch and Jax code for the Madam optimiser.
  ☆51Updated 4 years ago
• srush / torch-queue
  ☆67Updated last year
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆106Updated 4 months ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago
• EleutherAI / pyfra
  Python Research Framework
  ☆106Updated 2 years ago
• tmbdev-archive / tarproc
  Utilities for sequential processing of tar files.
  ☆24Updated 3 years ago
• zdevito / custom_loader
  ☆13Updated 3 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 9 months ago
• peidaqi / chiaki
  Free and Open Source PS4 Remote Play Client
  ☆15Updated 2 years ago
• Chillee / CS344_2021
  Udacity CS344 Introduction to Parallell Programming (https://classroom.udacity.com/courses/cs344), with assignments/materials updated to …
  ☆46Updated 3 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 4 years ago
• kyunghyuncho / backprop-kalman-filter
  ☆45Updated 5 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 3 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• unixpickle / vae-textures
  Texture mapping with variational auto-encoders
  ☆40Updated 3 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• HazyResearch / mongoose
  A Learnable LSH Framework for Efficient NN Training
  ☆31Updated 3 years ago