Alternatives and similar repositories for SLIDE_opt_ia:

Users that are interested in SLIDE_opt_ia are comparing it to the libraries listed below

• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆237Updated last year
• EleutherAI / pyfra
  Python Research Framework
  ☆106Updated 2 years ago
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆106Updated last month
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• facebookresearch / loop_tool
  A thin, highly portable toolkit for efficiently compiling dense loop-based computation.
  ☆148Updated 2 years ago
• podgorskiy / tensor4
  tensor4 - pytorch to C++ convertor using lightweight templated tensor library
  ☆28Updated 5 years ago
• HazyResearch / butterfly
  Butterfly matrix multiplication in PyTorch
  ☆166Updated last year
• unixpickle / vae-textures
  Texture mapping with variational auto-encoders
  ☆40Updated 3 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 3 years ago
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆38Updated 3 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆57Updated 3 years ago
• jxbz / nero
  👑 Pytorch code for the Nero optimiser.
  ☆20Updated 2 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• srush / torch-queue
  ☆67Updated last year
• RUSH-LAB / SLIDE
  ☆471Updated 3 years ago
• mryab / learning-at-home
  "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…
  ☆54Updated 4 years ago
• shawwn / ml-notes
  ☆39Updated 2 years ago
• iree-org / iree-jax
  ☆51Updated 6 months ago
• PrototypeML / PrototypeML
  ☆30Updated 4 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• facebookresearch / dietgpu
  GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compre…
  ☆322Updated 3 months ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆69Updated 3 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 2 weeks ago
• jxbz / madam
  👩 Pytorch and Jax code for the Madam optimiser.
  ☆51Updated 4 years ago
• beresandras / buggy-resizing-critique
  A criticism of a recent paper on buggy image downsampling methods in popular image processing and deep learning libraries.
  ☆72Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 6 months ago
• nestordemeure / flaxOptimizers
  A collection of optimizers, some arcane others well known, for Flax.
  ☆29Updated 3 years ago