This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
☆64Jun 7, 2025Updated last year
Alternatives and similar repositories for Building-a-Small-Language-Model-SLM-
Users that are interested in Building-a-Small-Language-Model-SLM- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A deep learning architecture for reference mining from literature in the arts and humanities.☆17Aug 14, 2019Updated 7 years ago
- OntoWiki component to visualize RDF-DataCubes☆34Aug 2, 2016Updated 10 years ago
- Python API for KB data-services☆20Jan 30, 2020Updated 6 years ago
- Informed Rapidly-exploring Random Tree-Star with C# Programming☆10Nov 6, 2021Updated 4 years ago
- Retrieve and extract citations from Crossref data☆29Mar 11, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A PHP utility library☆16Apr 27, 2023Updated 3 years ago
- named utilities for parsing bibliographic references from a number of standard formats (bibtext, endnote, medline, ris, xml (mods))☆15Feb 15, 2016Updated 10 years ago
- Repository for Delphix Terraform Provider built on DCT APIs.☆12Jul 3, 2026Updated last month
- A pre-compiler that lets you embed HTML into C code (like PHP but with C)☆12Jun 11, 2026Updated 2 months ago
- This repository provides the code for applying Contrastive Learning Penalty Loss (CLPL) and Mixture of Experts (MoE) to the BGE-M3 text e…☆11Dec 27, 2024Updated last year
- Automatically archive your repository's GitHub Pages in the Wayback Machine.☆27Jan 30, 2024Updated 2 years ago
- A zero-knowledge virtual machine with only one instruction☆13Mar 3, 2022Updated 4 years ago
- Rails application with Blazegraph for managing controlled vocabularies in RDF.☆22Sep 1, 2023Updated 2 years ago
- PHP with FPM Dockerfile for trusted automated Docker builds.☆12Mar 2, 2016Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- QC: Quantum Computing Simulator for C☆12Apr 8, 2024Updated 2 years ago
- ☆16Apr 30, 2025Updated last year
- 这是一个菜鸟关于视觉SLAM的学习笔记☆10Sep 29, 2019Updated 6 years ago
- Reinforcement learning for robot navigation in a Gazebo simulation using ROS 2, Stable-Baselines3, and Gymnasium.☆12Aug 20, 2024Updated last year
- High-performance localization software for autonomous vehicles. A particle filter is combined with a map to localize a vehicle.☆14Jan 13, 2021Updated 5 years ago
- Abstract 2D multi-robot multi-interface mobile robot simulator (fork of MobileSim simulator with various fixes, optimizations, and added …☆16May 30, 2023Updated 3 years ago
- Fast and accurate floating points conversions for C☆17Mar 4, 2025Updated last year
- Bad link reporter for GitHub repositories☆13Aug 3, 2026Updated last week
- A PHP client library to interact with Ex Libris Alma web services☆16May 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The final project of Autonomous Robotics of VIBOT program at University of Girona 2017.☆10Jul 24, 2017Updated 9 years ago
- Simple modern, small, zero dependency zip library for browser and node based JavaScript☆16Apr 3, 2026Updated 4 months ago
- ☆10Apr 1, 2020Updated 6 years ago
- A Terraform module that generates JSON documents for access for common AWS SSM Parameter Store policies☆17May 29, 2025Updated last year
- This module provides a full-featured IIIF Image API 2.1 and 3.0 image processor. It covers only the image processing pipeline itself, lea…☆33Updated this week
- A portable linker for multiple file formats.☆19Aug 28, 2023Updated 2 years ago
- ☆17Jan 31, 2025Updated last year
- ☆134Jan 9, 2026Updated 7 months ago
- Examine, a memory leak checker on Windows☆15Jun 4, 2016Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Experimenting with small language models☆75Jan 16, 2024Updated 2 years ago
- ActivityStreams 2.0 encoding/decoding for Go 1.18+☆13Aug 31, 2025Updated 11 months ago
- Collaborative bibliography on 'experimental writing' and 'financial crisis' from the Mute archive - http://metamute.org/archive☆10Dec 11, 2022Updated 3 years ago
- ALS Prolog Compiler & Development Environment☆21Jun 12, 2026Updated 2 months ago
- burn inference and training of dragon models 🔥🐉☆16Apr 12, 2026Updated 4 months ago
- SCI期刊信息爬虫☆14Jan 6, 2019Updated 7 years ago
- ModernVBERT is a 250M-parameter vision–language encoder that aligns a text-encoder (Ettin-150M) with a vision-encoder (SigLIP2-B) through…☆16Oct 16, 2025Updated 9 months ago