Alternatives and similar repositories for nGPT

Users that are interested in nGPT are comparing it to the libraries listed below

• edwardmilsom / function-space-learning-rates-paper

  View on GitHub
  Code for the paper "Function-Space Learning Rates"
  ☆25Jun 3, 2025Updated 8 months ago
• gau-nernst / kokoro

  View on GitHub
  https://hf.co/hexgrad/Kokoro-82M
  ☆14Jan 14, 2026Updated last month
• VatsaDev / NanoPoor

  View on GitHub
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆73Apr 22, 2025Updated 9 months ago
• cloneofsimo / repa-rf

  View on GitHub
  ☆33Nov 4, 2024Updated last year
• hkust-nlp / PreSelect

  View on GitHub
  [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches
  ☆60Mar 4, 2025Updated 11 months ago
• davisyoshida / abnormal-floats

  View on GitHub
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆21Jun 22, 2023Updated 2 years ago
• NVIDIA / ngpt

  View on GitHub
  Normalized Transformer (nGPT)
  ☆198Nov 19, 2024Updated last year
• fal-ai-community / nano-mdm

  View on GitHub
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆56Mar 10, 2025Updated 11 months ago
• kyleliang919 / Super_Muon

  View on GitHub
  ☆67Mar 21, 2025Updated 10 months ago
• CarperAI / treasure_trove

  View on GitHub
  ☆22Aug 27, 2023Updated 2 years ago
• cloneofsimo / minDinoV2

  View on GitHub
  ☆23Oct 15, 2024Updated last year
• main-horse / hnet-old

  View on GitHub
  H-Net Dynamic Hierarchical Architecture
  ☆81Sep 11, 2025Updated 5 months ago
• NousResearch / atropos

  View on GitHub
  Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …
  ☆853Feb 7, 2026Updated last week
• ndurner / mlx_chat

  View on GitHub
  Gradio chat interface for FastMLX
  ☆12Sep 22, 2024Updated last year
• cloneofsimo / min-max-in-dit

  View on GitHub
  ☆27May 3, 2024Updated last year
• kubernetes-bad / reward-composer

  View on GitHub
  Lego for GRPO
  ☆30May 27, 2025Updated 8 months ago
• tilde-research / MoMoE-impl

  View on GitHub
  Memory optimized Mixture of Experts
  ☆73Jul 25, 2025Updated 6 months ago
• bloc97 / DeMo

  View on GitHub
  DeMo: Decoupled Momentum Optimization
  ☆198Dec 2, 2024Updated last year
• epfml / schedules-and-scaling

  View on GitHub
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆89Oct 30, 2024Updated last year
• jfpuget / ARC-AGI-Challenge-2024

  View on GitHub
  ☆56Nov 22, 2024Updated last year
• Chillee / lit-llama

  View on GitHub
  Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code
  ☆10Aug 29, 2023Updated 2 years ago
• dayal-kalra / low-memory-adam

  View on GitHub
  ☆14Mar 2, 2025Updated 11 months ago
• sail-sg / Stable-RL

  View on GitHub
  Rethinking the Trust Region in LLM Reinforcement Learning
  ☆34Feb 5, 2026Updated last week
• theAdamColton / ijepa-enhanced

  View on GitHub
  recipe for training fully-featured self supervised image jepa models
  ☆12Jun 4, 2025Updated 8 months ago
• nikhilvyas / SOAP

  View on GitHub
  ☆250Dec 2, 2024Updated last year
• facebookresearch / llm-speedrunner

  View on GitHub
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆128Oct 9, 2025Updated 4 months ago
• jxmorris12 / embzip

  View on GitHub
  lossily compress representation vectors using product quantization
  ☆59Oct 28, 2025Updated 3 months ago
• thinking-machines-lab / manifolds

  View on GitHub
  Supporting code for the blog post on modular manifolds.
  ☆115Sep 26, 2025Updated 4 months ago
• minosvasilias / simple_grpo

  View on GitHub
  Simple GRPO scripts and configurations.
  ☆59Feb 6, 2025Updated last year
• eramax / CryptoPredictor

  View on GitHub
  .Net5 microservices example for cryptocurrencies price prediction using ML.NET, Vue, SignalR and massTransit
  ☆11May 18, 2021Updated 4 years ago
• Birch-san / booru-embed

  View on GitHub
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Mar 31, 2024Updated last year
• bentherien / mu_learned_optimization

  View on GitHub
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆14Mar 18, 2025Updated 10 months ago
• elad-amrani / xtra

  View on GitHub
  PyTorch implementation of "Sample- and Parameter-Efficient Auto-Regressive Image Models" from CVPR 2025
  ☆14Nov 21, 2025Updated 2 months ago
• giannisdaras / ambient-omni

  View on GitHub
  [NeurIPS 2025, Spotlight]: Ambient-o: Training Good models with Bad Data.
  ☆30Jan 21, 2026Updated 3 weeks ago
• davzha / multiset-equivariance

  View on GitHub
  ☆14Apr 7, 2022Updated 3 years ago
• scitix / MEAP

  View on GitHub
  Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
  ☆34May 17, 2025Updated 8 months ago
• elsatch / daily_hf_papers_abstracts

  View on GitHub
  This repository includes the code to download the curated HuggingFace papers into a single markdown formatted file
  ☆16Jul 26, 2024Updated last year
• cloneofsimo / zeroshampoo

  View on GitHub
  ☆34Sep 10, 2024Updated last year
• brendel-group / objects-compositional-generalization

  View on GitHub
  Official code for the paper "Provable Compositional Generalization for Object-Centric Learning" (ICLR 2024, oral)
  ☆15Aug 26, 2024Updated last year