Alternatives and similar repositories for ai-algorithms:

Users that are interested in ai-algorithms are comparing it to the libraries listed below

• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆158Updated last month
• apple / ml-sigmoid-attention
  ☆256Updated last week
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆187Updated last month
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆52Updated 10 months ago
• tensorgi / T6
  The official implementation of Tensor ProducT ATTenTion Transformer (T6)
  ☆311Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆177Updated last month
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆81Updated 3 weeks ago
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆129Updated 9 months ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆118Updated last month
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆198Updated 9 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆158Updated 2 months ago
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆35Updated last month
• llm-random / llm-random
  ☆181Updated this week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆149Updated 2 months ago
• zyushun / Adam-mini
  Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
  ☆388Updated 2 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆40Updated 9 months ago
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆35Updated 7 months ago
• kongds / MoRA
  MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
  ☆353Updated 6 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated 2 months ago
• NVlabs / hymba
  ☆171Updated 2 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆156Updated 3 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆195Updated 7 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆239Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆91Updated 5 months ago