This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
☆78Jun 7, 2025Updated last year
Alternatives and similar repositories for Building-a-Small-Language-Model-SLM-
Users that are interested in Building-a-Small-Language-Model-SLM- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A deep learning architecture for reference mining from literature in the arts and humanities.☆17Aug 14, 2019Updated 7 years ago
- Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.☆16Aug 7, 2025Updated last year
- Python API for KB data-services☆20Jan 30, 2020Updated 6 years ago
- Retrieve and extract citations from Crossref data☆29Mar 11, 2021Updated 5 years ago
- Natural Language Processing in Elixir☆19Mar 30, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A modern, colorful log analysis TUI built in Rust — pattern clustering, sparklines, fuzzy search, 8 themes☆21Feb 21, 2026Updated 7 months ago
- named utilities for parsing bibliographic references from a number of standard formats (bibtext, endnote, medline, ris, xml (mods))☆15Feb 15, 2016Updated 10 years ago
- Ontology Catalog in SQL to use with Timbr Intelligent Semantic Layer☆22Sep 8, 2025Updated last year
- Coq & Haskell code for Calculating Correct Compilers II☆12Feb 22, 2022Updated 4 years ago
- A pre-compiler that lets you embed HTML into C code (like PHP but with C)☆13Jun 11, 2026Updated 4 months ago
- Towards Optimal-Space Minimal Perfect Hashing Beyond Brute-Force☆15Mar 31, 2025Updated last year
- Backtesting engine in Elixir☆17Feb 16, 2026Updated 7 months ago
- Automatically archive your repository's GitHub Pages in the Wayback Machine.☆27Jan 30, 2024Updated 2 years ago
- ☆25Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Git sub-command to inform on the byte size of aspects of a Git clone☆13Aug 13, 2023Updated 3 years ago
- Neovim gutter support for jj☆24Aug 27, 2025Updated last year
- UTF-8 Handling in Standard ISO-C11☆12Dec 12, 2023Updated 2 years ago
- Ready-to-use Jujutsu configuration for stacked PR workflows☆20Jan 27, 2026Updated 8 months ago
- A Language Extension for VS Code that adds syntax highlighting for the Motorola 68k and its variants. Supports multiple assemblers.☆16Jul 15, 2026Updated 2 months ago
- Rails application with Blazegraph for managing controlled vocabularies in RDF.☆22Sep 1, 2023Updated 3 years ago
- ☆13Aug 26, 2024Updated 2 years ago
- iAmiga sources☆10Feb 3, 2024Updated 2 years ago
- ESDF generation, block-wise and iterative☆15Apr 24, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- k for BareMetal☆15Dec 10, 2024Updated last year
- Fast and accurate floating points conversions for C☆17Oct 5, 2026Updated last week
- A Pascal compiler for the Android Dalvik Byte Code (DEX)☆16Jun 10, 2019Updated 7 years ago
- Amiga DF0: / DF1: (_SEL0/_SEL1) internal automatic drive switch using Arduino Pro Mini and minimal hardware.☆12Mar 2, 2018Updated 8 years ago
- Breve☆30Jul 30, 2019Updated 7 years ago
- Another one RGB to HDMI solution for the Amiga 600☆13Feb 23, 2023Updated 3 years ago
- A portable linker for multiple file formats.☆20Aug 28, 2023Updated 3 years ago
- Say 'dreamier' and your ComfyUI workflow shifts — instantly, reversibly. An AI co-pilot for VFX artists: zero-LLM recipes (dreamier/sharp…☆25Jul 19, 2026Updated 2 months ago
- For a given tree builds an SVG based SunBurst diagram☆19Aug 1, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Examine, a memory leak checker on Windows☆15Jun 4, 2016Updated 10 years ago
- ActivityStreams 2.0 encoding/decoding for Go 1.18+☆13Aug 31, 2025Updated last year
- Collaborative bibliography on 'experimental writing' and 'financial crisis' from the Mute archive - http://metamute.org/archive☆10Dec 11, 2022Updated 3 years ago
- CHR2 to SQL conversion☆15Aug 27, 2015Updated 11 years ago
- ALS Prolog Compiler & Development Environment☆21Jun 12, 2026Updated 4 months ago
- Mayhem, the classic Amiga game, ported to the Raspberry Pi☆12Nov 18, 2021Updated 4 years ago
- Startup code for realtime graphics programming on Amiga 1200/4000☆11Apr 30, 2020Updated 6 years ago