Alternatives and similar repositories for mongoose

Users that are interested in mongoose are comparing it to the libraries listed below

• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 8 months ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• microsoft / DGT
  Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent
  ☆16Updated 3 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆91Updated this week
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• apd10 / universal_memory_allocation
  ☆15Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• johnryan465 / pscan
  ☆39Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆34Updated 4 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 10 months ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆50Updated 4 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆88Updated last year
• Yujun-Yan / Neural-Execution-Engines
  Code for Neural Execution Engines: Learning to Execute Subroutines
  ☆17Updated 4 years ago
• DS3Lab / CocktailSGD
  ☆26Updated 2 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆59Updated 3 years ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆96Updated 4 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated 2 years ago
• wouterkool / ancestral-gumbel-top-k-sampling
  Ancestral Gumbel-Top-k Sampling
  ☆25Updated 5 years ago
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆16Updated 4 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 3 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated 2 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• emalach / LinearLM
  Code for the paper: https://arxiv.org/pdf/2309.06979.pdf
  ☆21Updated last year
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆104Updated 5 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 3 years ago