Alternatives and similar repositories for mongoose

Users that are interested in mongoose are comparing it to the libraries listed below

• apd10 / universal_memory_allocation
  ☆15Updated 3 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 6 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆16Updated 4 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆89Updated last week
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• AndPotap / einsum-search
  ☆32Updated 10 months ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 11 months ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆51Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 8 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆35Updated last year
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 2 years ago
• microsoft / DGT
  Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent
  ☆15Updated 2 years ago
• arogozhnikov / adamw_bfloat16
  AdamW optimizer for bfloat16 models in pytorch 🔥.
  ☆36Updated last year
• DS3Lab / CocktailSGD
  ☆27Updated last year
• johnryan465 / pscan
  ☆40Updated last year
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆105Updated 4 years ago
• Yujun-Yan / Neural-Execution-Engines
  Code for Neural Execution Engines: Learning to Execute Subroutines
  ☆17Updated 4 years ago
• tt-embedding / tt-embeddings
  ☆27Updated 5 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• IDSIA / recurrent-fwp
  Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)
  ☆49Updated 2 months ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated last year
• samblouir / birdie
  ☆13Updated 2 months ago