code to train a gpt-2 model to train it on tiny stories dataset according to the TinyStories paper
☆44Nov 24, 2023Updated 2 years ago
Alternatives and similar repositories for TinyStories
Users that are interested in TinyStories are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reproducing GPT on the TinyStories dataset☆22Jan 18, 2024Updated 2 years ago
- Exploring the minimal architecture required for coherent English language generation.☆32Jun 11, 2026Updated 4 months ago
- Codebase for the paper "A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language"☆11Oct 11, 2024Updated 2 years ago
- ☆21May 24, 2023Updated 3 years ago
- ☆13Jan 6, 2026Updated 9 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆15Sep 29, 2022Updated 4 years ago
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- customizable template GPT code designed for easy novel architecture experimentation☆26Mar 19, 2025Updated last year
- 6,080-param transformer achieving 100% accuracy on 10-digit addition. Trained from scratch in 10 minutes.☆22Feb 19, 2026Updated 8 months ago
- ☆28Feb 20, 2026Updated 8 months ago
- ☆15May 20, 2023Updated 3 years ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Jun 6, 2023Updated 3 years ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆30Oct 14, 2025Updated last year
- JMLR Cover Letter Template☆10Dec 15, 2021Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A flutter plugin to run always-on speech to text service in the background.☆12Jan 16, 2022Updated 4 years ago
- ☆11Sep 25, 2025Updated last year
- A Tree of Thought Wiki☆10Mar 16, 2025Updated last year
- ☆35Jul 5, 2023Updated 3 years ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated 2 years ago
- annoy long term memory experiment for oobabooga/text-generation-webui☆30Jul 17, 2023Updated 3 years ago
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12May 24, 2021Updated 5 years ago
- Train toy models using multi-token prediction objective☆14Apr 18, 2026Updated 6 months ago
- ☆10Aug 7, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆38Nov 30, 2025Updated 11 months ago
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆35Oct 28, 2025Updated last year
- Official implementation of "Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thought" (NeurIPS 2025)☆45Oct 8, 2025Updated last year
- ☆42Feb 18, 2025Updated last year
- ☆14Nov 1, 2023Updated 3 years ago
- Collection of simple General Matrix Multiplication - GEMM implementations☆14Feb 26, 2024Updated 2 years ago
- ☆17Sep 24, 2026Updated last month
- SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models☆17Jun 24, 2024Updated 2 years ago
- Policy Transfer across Visual and Dynamics Domain Gaps via Iterative Grounding (RSS 2021)☆11Oct 22, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆13Jul 24, 2024Updated 2 years ago
- 《Akka HTTP 官方文档》中文版 🚀🚀🚀☆10Jan 23, 2018Updated 8 years ago
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆12Jun 21, 2023Updated 3 years ago
- ☆16Aug 17, 2026Updated 2 months ago
- ☆16Apr 15, 2026Updated 6 months ago
- Lightweight ternary QAT for ternary Bonsai models by Prism-ML☆17Sep 18, 2026Updated last month
- ☆19Jun 3, 2023Updated 3 years ago