TheMody / No-learning-rates-needed-Introducing-SALSA-Stable-Armijo-Line-Search-Adaptation

Related projects: ⓘ

• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆82Updated 3 weeks ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆59Updated 4 months ago
• epfml / DenseFormer
  ☆73Updated 5 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆153Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆63Updated last month
• ml-jku / hopfield-boosting
  ☆25Updated 4 months ago
• FusionBrainLab / LLM-Microscope
  ☆71Updated 3 weeks ago
• hyperevolnet / Terminator
  The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.
  ☆29Updated this week
• NVlabs / gbrl
  Gradient Boosting Reinforcement Learning
  ☆75Updated last week
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆105Updated 3 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆38Updated 3 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆53Updated last month
• AI-Guru / helibrunna
  A HuggingFace compatible xLSTM trainer.
  ☆57Updated last week
• kyegomez / MambaByte
  Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta
  ☆103Updated last week
• LAGoM-NLP / transtokenizer
  ☆23Updated last month
• nyunAI / nyuntam
  ☆59Updated last week
• EvanZhuang / MetaTree
  Official implementation of MetaTree: Learning a Decision Tree Algorithm with Transformers
  ☆97Updated last week
• SHI-Labs / CompactNet
  ☆30Updated 4 months ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆61Updated 4 months ago
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆57Updated 4 months ago
• kyegomez / swarms-pytorch
  Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
  ☆106Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆42Updated 3 weeks ago
• TorchJD / torchjd
  Library for Jacobian descent with PyTorch. It enables optimization of neural networks with multiple losses (e.g. multi-task learning).
  ☆126Updated this week
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆83Updated 2 months ago
• BlackHC / neural_net_checklist
  ☆137Updated last month
• dvruette / barrel-rec-pytorch
  ☆53Updated 8 months ago
• Renumics / sliceguard
  A library for detecting problematic data segments in structured and unstructured data with few lines of code.
  ☆61Updated 8 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆55Updated 2 weeks ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆50Updated 8 months ago
• Adamdad / kat
  Kolmogorov-Arnold Transformer: A PyTorch Implementation with CUDA kernel
  ☆221Updated this week