a small code base for training large models
☆337Apr 28, 2025Updated last year
Alternatives and similar repositories for gigaGPT
Users that are interested in gigaGPT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- Minimal Implimentation of VCRec (2024) for collapse provention.☆18Jan 28, 2025Updated last year
- RWKV in nanoGPT style☆199Jun 9, 2024Updated 2 years ago
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,243Aug 22, 2025Updated 11 months ago
- Jax like function transformation engine but micro, microjax☆34Oct 25, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Minimalistic large language model 3D-parallelism training☆2,779May 26, 2026Updated 2 months ago
- The repository for the code of the UltraFastBERT paper☆518Mar 24, 2024Updated 2 years ago
- ☆63Sep 23, 2024Updated last year
- ☆71Jul 11, 2024Updated 2 years ago
- Port of Andrej Karpathy's nanoGPT to Apple MLX framework.☆123Feb 12, 2024Updated 2 years ago
- Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"☆32Oct 12, 2023Updated 2 years ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆256Jun 6, 2025Updated last year
- ☆1,185May 1, 2026Updated 3 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,612Jul 20, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Reversal Curse Experiment☆15Sep 24, 2023Updated 2 years ago
- ☆15Oct 4, 2024Updated last year
- Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and …☆220Jul 24, 2026Updated 2 weeks ago
- Rust binding for WFA2-lib☆10Jun 7, 2022Updated 4 years ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 2 years ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,274Aug 26, 2025Updated 11 months ago
- ☆143Mar 31, 2023Updated 3 years ago
- Simple repository for training small reasoning models☆51Updated this week
- Tools for merging pretrained large language models.☆7,288Jun 17, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Scaling Data-Constrained Language Models☆345Jun 28, 2025Updated last year
- Common tools for data processing☆22Dec 8, 2025Updated 8 months ago
- Pan gGnome Viewer☆10Jul 10, 2025Updated last year
- A collection of reproducible inference engine benchmarks☆38Apr 22, 2025Updated last year
- ☆20Nov 14, 2025Updated 8 months ago
- Schedule-Free Optimization in PyTorch☆2,323Jul 28, 2026Updated last week
- A really tiny autograd engine☆100May 26, 2025Updated last year
- Inference Llama 2 in one file of pure C☆19,955Aug 6, 2024Updated 2 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,086Jul 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NanoGPT (124M) in 90 seconds☆5,654Aug 2, 2026Updated last week
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆22Nov 25, 2024Updated last year
- Video+code lecture on building nanoGPT from scratch☆65Jun 14, 2024Updated 2 years ago
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆546May 16, 2025Updated last year
- Auto-Video maker handling many AI's☆11Mar 18, 2024Updated 2 years ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Apr 22, 2025Updated last year
- ☆315Jun 21, 2024Updated 2 years ago