a small code base for training large models
☆345Apr 28, 2025Updated last year
Alternatives and similar repositories for gigaGPT
Users that are interested in gigaGPT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,271Aug 22, 2025Updated last year
- ☆1,212Sep 1, 2026Updated 2 months ago
- RWKV in nanoGPT style☆199Jun 9, 2024Updated 2 years ago
- Inference examples☆85Apr 20, 2026Updated 6 months ago
- Minimalistic large language model 3D-parallelism training☆2,859Oct 8, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Nov 14, 2025Updated 11 months ago
- The repository for the code of the UltraFastBERT paper☆518Mar 24, 2024Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated 2 years ago
- ☆62Sep 23, 2024Updated 2 years ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Apr 22, 2025Updated last year
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,748Updated this week
- Tools for merging pretrained large language models.☆7,448Oct 31, 2026Updated last week
- Schedule-Free Optimization in PyTorch☆2,335Jul 28, 2026Updated 3 months ago
- ☆71Jul 11, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ShellSpeak translates natural language to shell commands, simplifying system interactions for non-tech-savvy users. With color-coded UI, …☆12Nov 26, 2023Updated 2 years ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆71Aug 21, 2024Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆258Jun 6, 2025Updated last year
- Inference Llama 2 in one file of pure C☆20,269Aug 6, 2024Updated 2 years ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,340Aug 26, 2025Updated last year
- A really tiny autograd engine☆99May 26, 2025Updated last year
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- NanoGPT (124M) in 90 seconds☆6,026Sep 28, 2026Updated last month
- Reversal Curse Experiment☆15Sep 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- For optimization algorithm research and development.☆585Oct 23, 2026Updated 2 weeks ago
- Go ahead and axolotl questions☆12,689Updated this week
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,080Jul 1, 2025Updated last year
- Port of Andrej Karpathy's nanoGPT to Apple MLX framework.☆123Feb 12, 2024Updated 2 years ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆9,005May 3, 2024Updated 2 years ago
- Tensor library for machine learning☆15,618Updated this week
- ☆144Mar 31, 2023Updated 3 years ago
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,174Oct 8, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A multi-purpose LLM framework for RAG and data creation.☆622Jan 13, 2024Updated 2 years ago
- Library to facilitate pruning of LLMs based on context☆32Jan 31, 2024Updated 2 years ago
- ☆314Sep 11, 2026Updated 2 months ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆25,022Aug 15, 2024Updated 2 years ago
- Optimizing diffusion for production-ready speeds☆41Jan 10, 2026Updated 10 months ago
- Video+code lecture on building nanoGPT from scratch☆66Jun 14, 2024Updated 2 years ago
- Simple repository for training small reasoning models☆53Aug 4, 2026Updated 3 months ago
Are these results useful?