This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
☆71Jun 7, 2025Updated last year
Alternatives and similar repositories for Building-a-Small-Language-Model-SLM-
Users that are interested in Building-a-Small-Language-Model-SLM- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.☆16Aug 7, 2025Updated last year
- OntoWiki component to visualize RDF-DataCubes☆34Aug 2, 2016Updated 10 years ago
- Python API for KB data-services☆20Jan 30, 2020Updated 6 years ago
- Retrieve and extract citations from Crossref data☆29Mar 11, 2021Updated 5 years ago
- A PHP utility library☆16Apr 27, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The pytvision package consists of my datasets, models, and image transformations methods for computer vision projects. This package also …☆10Aug 21, 2023Updated 3 years ago
- named utilities for parsing bibliographic references from a number of standard formats (bibtext, endnote, medline, ris, xml (mods))☆15Feb 15, 2016Updated 10 years ago
- Repository to store the OpenSource version of the code made by E84 for OceanBestPractices.org☆12Aug 3, 2026Updated last month
- momote001 CC2650 based IoT mote☆10Aug 17, 2016Updated 10 years ago
- A pre-compiler that lets you embed HTML into C code (like PHP but with C)☆13Jun 11, 2026Updated 2 months ago
- A gallery of mainly Jupyter Notebooks but also more, dedicated to Copernicus Marine Service (CMEMS).☆14Aug 6, 2021Updated 5 years ago
- Automatically archive your repository's GitHub Pages in the Wayback Machine.☆28Jan 30, 2024Updated 2 years ago
- ☆24Updated this week
- ☆11Nov 14, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Generate and Parse CoAP packets☆33Feb 3, 2022Updated 4 years ago
- UTF-8 Handling in Standard ISO-C11☆12Dec 12, 2023Updated 2 years ago
- A ROS 2 based simulator-agnostic Digital Twin for the Lunar South Pole to simulate NASA's Artemis Missions 🌝☆17Jul 26, 2026Updated last month
- A zero-knowledge virtual machine with only one instruction☆13Mar 3, 2022Updated 4 years ago
- Ecore metamodel reverse engineering: Automatically extract EMF metamodels from Java code.☆13Feb 12, 2022Updated 4 years ago
- Loka Sigfox Device SDK☆10Aug 7, 2017Updated 9 years ago
- Rails application with Blazegraph for managing controlled vocabularies in RDF.☆22Sep 1, 2023Updated 3 years ago
- QC: Quantum Computing Simulator for C☆12Apr 8, 2024Updated 2 years ago
- wMbus receiver based on STM32L476 Nucleo and Hope RF95☆15Nov 5, 2017Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Aug 26, 2024Updated 2 years ago
- iAmiga sources☆10Feb 3, 2024Updated 2 years ago
- Code, data and instructions for the Diva workshops☆19Aug 21, 2026Updated last week
- ESDF generation, block-wise and iterative☆15Apr 24, 2024Updated 2 years ago
- ρζητα ⇒ rosetta☆18May 3, 2022Updated 4 years ago
- k for BareMetal☆13Dec 10, 2024Updated last year
- Fast and accurate floating points conversions for C☆17Mar 4, 2025Updated last year
- Bad link reporter for GitHub repositories☆13Aug 3, 2026Updated last month
- Codigos referentes a disciplina Storytelling com Dados e Design de Dashboards - CESAR School☆12Feb 8, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Nov 16, 2020Updated 5 years ago
- ☆16May 23, 2026Updated 3 months ago
- Amiga DF0: / DF1: (_SEL0/_SEL1) internal automatic drive switch using Arduino Pro Mini and minimal hardware.☆12Mar 2, 2018Updated 8 years ago
- ☆13Oct 18, 2016Updated 9 years ago
- Breve☆30Jul 30, 2019Updated 7 years ago
- Another one RGB to HDMI solution for the Amiga 600☆13Feb 23, 2023Updated 3 years ago
- This module provides a full-featured IIIF Image API 2.1 and 3.0 image processor. It covers only the image processing pipeline itself, lea…☆33Aug 10, 2026Updated 3 weeks ago