Alternatives and similar repositories for SLIDE_opt_ia:

Users that are interested in SLIDE_opt_ia are comparing it to the libraries listed below

• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated 2 years ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆237Updated last year
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆106Updated 2 months ago
• nestordemeure / flaxOptimizers
  A collection of optimizers, some arcane others well known, for Flax.
  ☆29Updated 3 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆54Updated 3 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 7 months ago
• ezyang / stride-visualizer
  Stride visualizations
  ☆37Updated 6 years ago
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆65Updated last year
• HazyResearch / mongoose
  A Learnable LSH Framework for Efficient NN Training
  ☆31Updated 3 years ago
• shawwn / ml-notes
  ☆39Updated 2 years ago
• facebookresearch / DLRM-FlexFlow
  Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…
  ☆28Updated 3 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• jxbz / nero
  👑 Pytorch code for the Nero optimiser.
  ☆20Updated 2 years ago
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆256Updated 2 years ago
• AMYPAD / CuVec
  Unifying Python/C++/CUDA memory: Python buffered array ↔️ `std::vector` ↔️ CUDA managed memory
  ☆80Updated 3 weeks ago
• nv-legate / legate
  The Foundation for All Legate Libraries
  ☆207Updated this week
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• srush / torch-queue
  ☆68Updated last year
• nv-legate / legate.pandas
  An Aspiring Drop-In Replacement for Pandas at Scale
  ☆75Updated 3 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• yifding / hetseq
  HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
  ☆106Updated last year
• zdevito / custom_loader
  ☆13Updated 3 years ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆178Updated 3 months ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 4 years ago
• RUSH-LAB / SLIDE
  ☆471Updated 3 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated last month
• nlpodyssey / goslide
  SLIDE (Sub-LInear Deep learning Engine) written in Go
  ☆44Updated 4 years ago
• facebookresearch / FBTT-Embedding
  This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …
  ☆193Updated 2 years ago
• distdl / distdl
  ☆21Updated 2 years ago