Alternatives and similar repositories for No-learning-rates-needed-Introducing-SALSA-Stable-Armijo-Line-Search-Adaptation:

Users that are interested in No-learning-rates-needed-Introducing-SALSA-Stable-Armijo-Line-Search-Adaptation are comparing it to the libraries listed below

• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆95Updated 3 weeks ago
• AI-Guru / helibrunna
  A HuggingFace compatible Small Language Model trainer.
  ☆74Updated 3 months ago
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆46Updated 2 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆76Updated 8 months ago
• epfml / DenseFormer
  ☆78Updated 9 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆168Updated last month
• Aleph-Alpha / trigrams
  ☆49Updated 4 months ago
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆31Updated this week
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆69Updated last month
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆113Updated 7 months ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆59Updated 8 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆60Updated 7 months ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆47Updated 3 months ago
• cloneofsimo / infinite-fractal-stream
  ☆30Updated 3 months ago
• NVlabs / gbrl
  Gradient Boosting Reinforcement Learning (GBRL)
  ☆95Updated last month
• LAGoM-NLP / transtokenizer
  ☆34Updated 4 months ago
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆81Updated 3 weeks ago
• euclaise / supertrainer2000
  ☆49Updated 10 months ago
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆65Updated 8 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆76Updated last week
• apple / ml-mofi
  ☆58Updated 10 months ago
• apple / ml-ademamix
  ☆52Updated 2 months ago
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆178Updated 4 months ago
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆85Updated 2 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 9 months ago
• BlackHC / neural_net_checklist
  ☆149Updated 5 months ago
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆98Updated last month
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆14Updated 2 weeks ago
• nikhilvyas / SOAP
  ☆146Updated last month