Alternatives and similar repositories for mongoose

Users that are interested in mongoose are comparing it to the libraries listed below

• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆30Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆95Updated this week
• microsoft / DGT
  Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent
  ☆17Updated 3 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated 2 years ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆51Updated 8 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆69Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated 2 years ago
• AndPotap / einsum-search
  ☆33Updated last year
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆16Updated 4 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆49Updated 4 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 3 years ago
• tt-embedding / tt-embeddings
  ☆28Updated 6 years ago
• apd10 / universal_memory_allocation
  ☆15Updated 3 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆61Updated 3 years ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆36Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆51Updated 2 years ago
• wouterkool / ancestral-gumbel-top-k-sampling
  Ancestral Gumbel-Top-k Sampling
  ☆25Updated 5 years ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆93Updated 2 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated 2 years ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆40Updated 2 years ago
• dylandoblar / noether-networks
  Meta-learning inductive biases in the form of useful conserved quantities.
  ☆39Updated 3 years ago
• cybertronai / bflm
  ☆17Updated 6 years ago