Alternatives and similar repositories for fast_sligru

Users that are interested in fast_sligru are comparing it to the libraries listed below

• lessw2020 / FAdam_PyTorch
  an implementation of FAdam (Fisher Adam) in PyTorch
  ☆43Updated last year
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆56Updated last year
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated last week
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆47Updated 8 months ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated 3 weeks ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆36Updated 3 months ago
• fal-ai-community / NativeSparseAttention
  research impl of Native Sparse Attention (2502.11089)
  ☆54Updated 3 months ago
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆121Updated 10 months ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆51Updated 2 months ago
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆56Updated 2 weeks ago
• facebookresearch / flashy
  Framework for writing deep learning training loops. Lightweight, and retaining full freedom to design as you see fits. It handles checkpo…
  ☆112Updated last year
• thomwolf / sesame-explorations
  ☆29Updated last month
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆41Updated last month
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆24Updated 3 months ago
• erogol / BlaGPT
  Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…
  ☆36Updated last week
• sustcsonglin / mamba-triton
  ☆47Updated last year
• cloneofsimo / zeroshampoo
  ☆34Updated 8 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• ClashLuke / SOAP
  ☆21Updated 6 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆90Updated 11 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 7 months ago
• j10labs / wandview
  Mobile Viewer for W&B, built on top of Flutter.
  ☆34Updated last year
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆63Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 8 months ago
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆106Updated 6 months ago
• Fchaubard / gradient_agreement_filtering
  This is the official repo for Gradient Agreement Filtering (GAF).
  ☆24Updated 4 months ago
• schneiderkamplab / bitlinear
  BitLinear implementation
  ☆29Updated 5 months ago
• HomebrewML / TrueGrad
  PyTorch interface for TrueGrad Optimizers
  ☆42Updated last year
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆83Updated 3 months ago