a small code base for training large models
☆344Apr 28, 2025Updated last year
Alternatives and similar repositories for gigaGPT
Users that are interested in gigaGPT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Minimal Implimentation of VCRec (2024) for collapse provention.☆18Jan 28, 2025Updated last year
- RWKV in nanoGPT style☆200Jun 9, 2024Updated 2 years ago
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,256Aug 22, 2025Updated last year
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Minimalistic large language model 3D-parallelism training☆2,827Sep 23, 2026Updated last week
- The repository for the code of the UltraFastBERT paper☆518Mar 24, 2024Updated 2 years ago
- ☆62Sep 23, 2024Updated 2 years ago
- ☆71Jul 11, 2024Updated 2 years ago
- Port of Andrej Karpathy's nanoGPT to Apple MLX framework.☆122Feb 12, 2024Updated 2 years ago
- Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"☆33Oct 12, 2023Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆258Jun 6, 2025Updated last year
- ☆1,202Sep 1, 2026Updated 3 weeks ago
- ShellSpeak translates natural language to shell commands, simplifying system interactions for non-tech-savvy users. With color-coded UI, …☆12Nov 26, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,687Sep 14, 2026Updated 2 weeks ago
- Reversal Curse Experiment☆15Sep 24, 2023Updated 3 years ago
- ☆15Oct 4, 2024Updated last year
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆221Jul 24, 2026Updated 2 months ago
- Rust binding for WFA2-lib☆10Jun 7, 2022Updated 4 years ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,313Aug 26, 2025Updated last year
- ☆144Mar 31, 2023Updated 3 years ago
- Simple repository for training small reasoning models☆51Aug 4, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tools for merging pretrained large language models.☆7,380Sep 12, 2026Updated 2 weeks ago
- Scaling Data-Constrained Language Models☆345Jun 28, 2025Updated last year
- Common tools for data processing☆22Dec 8, 2025Updated 9 months ago
- Pan gGnome Viewer☆10Updated this week
- A collection of reproducible inference engine benchmarks☆38Apr 22, 2025Updated last year
- ☆20Nov 14, 2025Updated 10 months ago
- Schedule-Free Optimization in PyTorch☆2,322Jul 28, 2026Updated 2 months ago
- DataComp for Language Models☆1,475Sep 9, 2025Updated last year
- A really tiny autograd engine☆99May 26, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Inference Llama 2 in one file of pure C☆20,125Aug 6, 2024Updated 2 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,080Jul 1, 2025Updated last year
- Video+code lecture on building nanoGPT from scratch☆65Jun 14, 2024Updated 2 years ago
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆22Nov 25, 2024Updated last year
- NanoGPT (124M) in 90 seconds☆5,869Updated this week
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆545May 16, 2025Updated last year
- Auto-Video maker handling many AI's☆11Mar 18, 2024Updated 2 years ago