NanoGPT-speedrunning for the poor T4 enjoyers
☆72Apr 22, 2025Updated last year
Alternatives and similar repositories for NanoPoor
Users that are interested in NanoPoor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Nov 14, 2024Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated 2 years ago
- ☆11Mar 29, 2025Updated last year
- minimal pytorch 4D parallelism☆74Feb 16, 2026Updated 9 months ago
- ☆45Mar 31, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LM/VLM implementations☆12Oct 13, 2026Updated last month
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆92Sep 12, 2025Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆112Mar 7, 2025Updated last year
- Collection of autoregressive model implementation☆85Oct 1, 2026Updated last month
- ☆27Jul 9, 2024Updated 2 years ago
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆23Apr 7, 2024Updated 2 years ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆18Apr 30, 2025Updated last year
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Mar 10, 2025Updated last year
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆145May 8, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- minimal Energy-based transformer☆43Dec 11, 2025Updated 11 months ago
- ☆33Sep 10, 2024Updated 2 years ago
- ☆14Mar 2, 2025Updated last year
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 8 months ago
- ☆47May 24, 2025Updated last year
- Toy meta-RL environments for testing algorithms implementations☆10Feb 21, 2024Updated 2 years ago
- smol models are fun too☆94Nov 9, 2024Updated 2 years ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆127Apr 21, 2025Updated last year
- ☆69Mar 21, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆23Oct 18, 2026Updated last month
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- Handles everything related to working with instruction datasets☆11Dec 19, 2023Updated 2 years ago
- Official codebase for our paper "Do Language Models Use Their Depth Efficiently?"☆30Jun 25, 2025Updated last year
- PyTorch-ready drop-in Triton-based Gated SSM for ultra-long sequences. Heavily optimized. Suitable for pre-training and fine-tuning.☆10Dec 16, 2025Updated 11 months ago
- The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"☆20Jul 24, 2024Updated 2 years ago
- nanogpt turned into a chat model☆80Aug 30, 2023Updated 3 years ago
- ☆19Dec 4, 2025Updated 11 months ago
- ☆15Jan 26, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- assign color hues to a collection of text fragments based on embeddings☆20Jun 15, 2024Updated 2 years ago
- ☆14Jan 22, 2026Updated 9 months ago
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated 2 years ago
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- Small autodiff lib and a simple working feedforward neural net in Haskell on top of it, from scratch, zero-deps.☆16Jun 21, 2024Updated 2 years ago
- ☆14Oct 21, 2024Updated 2 years ago
Are these results useful?