This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
☆58Jun 7, 2025Updated last year
Alternatives and similar repositories for Building-a-Small-Language-Model-SLM-
Users that are interested in Building-a-Small-Language-Model-SLM- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A deep learning architecture for reference mining from literature in the arts and humanities.☆17Aug 14, 2019Updated 6 years ago
- Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.☆16Aug 7, 2025Updated 11 months ago
- Retrieve and extract citations from Crossref data☆29Mar 11, 2021Updated 5 years ago
- Python API for KB data-services☆20Jan 30, 2020Updated 6 years ago
- A PHP utility library☆16Apr 27, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- named utilities for parsing bibliographic references from a number of standard formats (bibtext, endnote, medline, ris, xml (mods))☆15Feb 15, 2016Updated 10 years ago
- Ontology Catalog in SQL to use with Timbr Intelligent Semantic Layer☆19Sep 8, 2025Updated 10 months ago
- A pre-compiler that lets you embed HTML into C code (like PHP but with C)☆12Jun 11, 2026Updated last month
- Towards Optimal-Space Minimal Perfect Hashing Beyond Brute-Force☆15Mar 31, 2025Updated last year
- Automatically archive your repository's GitHub Pages in the Wayback Machine.☆27Jan 30, 2024Updated 2 years ago
- Quantum-Machine-Learning, published by Packt☆12Jan 18, 2021Updated 5 years ago
- Git sub-command to inform on the byte size of aspects of a Git clone☆13Aug 13, 2023Updated 2 years ago
- A zero-knowledge virtual machine with only one instruction☆13Mar 3, 2022Updated 4 years ago
- QC: Quantum Computing Simulator for C☆12Apr 8, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Language Extension for VS Code that adds syntax highlighting for the Motorola 68k and its variants. Supports multiple assemblers.☆14Updated this week
- SRL_smp is a Sampling-Based Motion Planner library implemented in ROS designed for a differential drive robot.The package contains also a…☆10Jul 24, 2014Updated 11 years ago
- PHP with FPM Dockerfile for trusted automated Docker builds.☆12Mar 2, 2016Updated 10 years ago
- ☆16Apr 30, 2025Updated last year
- ESDF generation, block-wise and iterative☆15Apr 24, 2024Updated 2 years ago
- Fast and accurate floating points conversions for C☆17Mar 4, 2025Updated last year
- iAmiga sources☆10Feb 3, 2024Updated 2 years ago
- k for BareMetal☆13Dec 10, 2024Updated last year
- RSoft is a software rendering library oriented around math.☆15Mar 29, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Bad link reporter for GitHub repositories☆13Mar 25, 2024Updated 2 years ago
- A PHP client library to interact with Ex Libris Alma web services☆16May 7, 2024Updated 2 years ago
- The final project of Autonomous Robotics of VIBOT program at University of Girona 2017.☆10Jul 24, 2017Updated 8 years ago
- A language-agnostic JSON-encoded instruction-by-instruction test suite for the 68000.☆11May 14, 2024Updated 2 years ago
- Amiga DF0: / DF1: (_SEL0/_SEL1) internal automatic drive switch using Arduino Pro Mini and minimal hardware.☆12Mar 2, 2018Updated 8 years ago
- Breve☆30Jul 30, 2019Updated 6 years ago
- This module provides a full-featured IIIF Image API 2.1 and 3.0 image processor. It covers only the image processing pipeline itself, lea…☆33Jun 10, 2026Updated last month
- Source Code for 'Bitcoin and Lightning Network on Raspberry Pi: Running Nodes on Pi3, Pi4 and Pi Zero' by Harris Brakmic☆13Jul 12, 2023Updated 3 years ago
- ☆17Jan 31, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ActivityStreams 2.0 encoding/decoding for Go 1.18+☆13Aug 31, 2025Updated 10 months ago
- Collaborative bibliography on 'experimental writing' and 'financial crisis' from the Mute archive - http://metamute.org/archive☆10Dec 11, 2022Updated 3 years ago
- GWR Toolbox☆14Jan 28, 2019Updated 7 years ago
- SCI期刊 信息爬虫☆14Jan 6, 2019Updated 7 years ago
- the xoroshiro32++ and xoroshiro64++ PRNG algorthims by David Blackman and Sebastiano Vigna in C++, Verilog, VHDL and SpinalHDL.☆16Dec 2, 2018Updated 7 years ago
- Convert Transkribus PAGE-XML to standard PAGE-XML☆12Dec 10, 2025Updated 7 months ago
- Part-of-speech tagger for the English language☆10Jul 31, 2018Updated 7 years ago