Alternatives and similar repositories for ai-algorithms

Users that are interested in ai-algorithms are comparing it to the libraries listed below

• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆168Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆88Updated 2 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆103Updated this week
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆140Updated 2 months ago
• tensorgi / T6
  The official implementation of Tensor ProducT ATTenTion Transformer (T6)
  ☆368Updated 3 weeks ago
• menloresearch / visual-thinker
  ☆151Updated last week
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆116Updated 11 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆202Updated last year
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆323Updated 5 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆191Updated last month
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆206Updated last week
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆359Updated this week
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆35Updated 9 months ago
• fxmeng / TransMLA
  TransMLA: Multi-Head Latent Attention Is All You Need
  ☆247Updated this week
• kabir2505 / tiny-mixtral
  ☆30Updated last week
• kyegomez / LFM
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆165Updated 3 weeks ago
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆28Updated 2 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆91Updated this week
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆166Updated 4 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆154Updated last month
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆41Updated 4 months ago
• NVlabs / hymba
  ☆176Updated 5 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆214Updated last year
• convergence-ai / lm2
  Official repo of paper LM2
  ☆39Updated 3 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆192Updated 3 weeks ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆104Updated last month
• kyegomez / Python-Package-Template
  A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much muc…
  ☆172Updated last month
• kongds / MoRA
  MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
  ☆356Updated 9 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 11 months ago