Alternatives and similar repositories for flaim

Users that are interested in flaim are comparing it to the libraries listed below

• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆13Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated last year
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆19Updated 11 months ago
• lucidrains / local-attention-flax
  Local Attention - Flax module for Jax
  ☆22Updated 4 years ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆29Updated 5 years ago
• ColinQiyangLi / AdaCat
  AdaCat
  ☆49Updated 3 years ago
• theAdamColton / ijepa-enhanced
  recipe for training fully-featured self supervised image jepa models
  ☆10Updated 5 months ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• hunar4321 / RLS-neural-net
  Recursive Leasting Squares (RLS) with Neural Network for fast learning
  ☆56Updated 2 years ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆55Updated 7 months ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆60Updated 3 years ago
• Yuanhy1997 / HyPe
  HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]
  ☆14Updated 2 years ago
• nreHieW / loss
  Visualising Losses in Deep Neural Networks
  ☆16Updated last year
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• kachayev / dataclasses-tensor
  Easily serialize dataclasses to and from tensors (PyTorch, NumPy)
  ☆18Updated 4 years ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆59Updated 2 years ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆49Updated last year
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• samblouir / birdie
  ☆13Updated 5 months ago
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆37Updated last year
• google-research / precondition
  ☆31Updated this week
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆39Updated 3 years ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆32Updated 2 years ago
• lucidrains / metaformer-gpt
  Implementation of Metaformer, but in an autoregressive manner
  ☆26Updated 3 years ago
• Doraemonzzz / hgru-pytorch
  ☆28Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆25Updated 8 months ago
• Doraemonzzz / hgru2-pytorch
  ☆23Updated last year
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated last year