Alternatives and similar repositories for mongoose:

Users that are interested in mongoose are comparing it to the libraries listed below

• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated last month
• apd10 / universal_memory_allocation
  ☆15Updated 2 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆12Updated 3 years ago
• Yujun-Yan / Neural-Execution-Engines
  Code for Neural Execution Engines: Learning to Execute Subroutines
  ☆17Updated 4 years ago
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆37Updated 2 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆64Updated 3 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• vvvm23 / mezo-jax
  JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"
  ☆19Updated last year
• Jokeren / triton-samples
  ☆26Updated last month
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆32Updated 10 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆42Updated 5 months ago
• stanford-crfm / helm-efficiency
  ☆9Updated last year
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆61Updated 3 years ago
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• AndPotap / einsum-search
  ☆30Updated 5 months ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆48Updated last year
• arogozhnikov / adamw_bfloat16
  AdamW optimizer for bfloat16 models in pytorch 🔥.
  ☆31Updated 8 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆43Updated 7 months ago
• daochenzha / dreamshard
  [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems
  ☆29Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆28Updated last year
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆19Updated 7 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 9 months ago
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆12Updated 3 months ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• srush / transformers-bet
  ☆12Updated 3 years ago
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated this week