Alternatives and similar repositories for ai-algorithms

Users that are interested in ai-algorithms are comparing it to the libraries listed below

• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆105Updated last month
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆171Updated 2 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆152Updated 3 months ago
• tensorgi / TPA
  The official implementation of Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)
  ☆375Updated last week
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆55Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 3 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆196Updated 2 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆182Updated 5 months ago
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆29Updated 4 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆230Updated last month
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆175Updated this week
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆96Updated last year
• NVlabs / hymba
  ☆178Updated 6 months ago
• apple / ml-sigmoid-attention
  ☆286Updated 2 months ago
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆247Updated 4 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆127Updated 10 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆339Updated 6 months ago
• menloresearch / visual-thinker
  ☆158Updated last month
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆130Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆91Updated 7 months ago
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆169Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆118Updated last year
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆35Updated 10 months ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆221Updated last month
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆385Updated last week
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆95Updated 2 weeks ago
• kyegomez / LFM
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆168Updated 3 weeks ago
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆42Updated 5 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 3 months ago