This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.
☆79Jun 7, 2025Updated last year
Alternatives and similar repositories for Building-a-Small-Language-Model-SLM-
Users that are interested in Building-a-Small-Language-Model-SLM- are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Social Network Analysis and STEM Education is designed to prepare researchers to apply network analysis in order to better understand and…☆16Jul 14, 2025Updated last year
- Run Structured LLM Inference with Easy Parallelism☆18Jul 30, 2025Updated last year
- An analysis of 9 terrorist attack networks across various countries between the years 2000 and 2005 using a Gephi network graph visualiza…☆13Dec 25, 2019Updated 6 years ago
- ☆15Jun 13, 2025Updated last year
- ☆16Feb 12, 2019Updated 7 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.☆16Aug 7, 2025Updated last year
- covo.js☆10Sep 29, 2012Updated 14 years ago
- pynumad is an object-oriented, open-source software program written in Python which simplifies the process of creating a three-dimensiona…☆27Mar 24, 2026Updated 7 months ago
- Comprehensive-Guide-for-Small-Language-Model-Development☆29Oct 20, 2024Updated 2 years ago
- A small PHP library to interact with Garlik's 4Store☆11Mar 12, 2012Updated 14 years ago
- A library resource discovery portal designed and developed for libraries by libraries☆12Jan 25, 2021Updated 5 years ago
- ☆10Nov 18, 2025Updated 11 months ago
- Give Pi an external monitor (forked from Paul Siegal's Claude Canvas and modified)☆25Feb 23, 2026Updated 8 months ago
- Retrieve and extract citations from Crossref data☆29Mar 11, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆32May 17, 2026Updated 5 months ago
- Production setup/configuration for ALICE (Run3) Data processing and Monte Carlo☆11Updated this week
- Web services at Inist-CNRS☆15Oct 23, 2026Updated 2 weeks ago
- Pi extension package for Jujutsu workflows☆10Mar 2, 2026Updated 8 months ago
- A Neo-tree source for Jujustsu/jj☆14May 10, 2024Updated 2 years ago
- An example of simple API Gateway with NodeJS and ExpressJs☆30Dec 22, 2022Updated 3 years ago
- Allbert Assist is a local-first assistant runtime for long-running personal work built in elixir/otp, jido agents etc☆12Aug 15, 2026Updated 2 months ago
- named utilities for parsing bibliographic references from a number of standard formats (bibtext, endnote, medline, ris, xml (mods))☆15Feb 15, 2016Updated 10 years ago
- MatSci-LumEn: Materials Science Large Language Models Evaluation for text and data mining☆12Aug 8, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is the code repository for the AI project template. The idea of this template is to have a code framework prepared for any AI/ML/MLO…☆44Jan 26, 2026Updated 9 months ago
- C HTML Template Library☆11Jan 19, 2022Updated 4 years ago
- Webz.io Python SDK☆45Apr 17, 2022Updated 4 years ago
- Neuro-Symbolic RL agent plays MiniHack☆10Mar 30, 2026Updated 7 months ago
- A deliberative software agent using Perl/Prolog/Emacs able to plan and execute language functions, programs and shell commands☆12May 17, 2019Updated 7 years ago
- SDK-first chat core for Jido (models, content blocks, capabilities, adapter contracts).☆11Updated this week
- Per-turn model routing for the Pi coding agent: a small judge picks the cheap or the strong tier for each message, with multi-model failo…☆13Oct 24, 2026Updated last week
- ☆12Oct 24, 2024Updated 2 years ago
- Dream-RSI for pi: assess projects, apply verified code improvements, and evolve exploration policies within bounded runs.☆14Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆12Apr 11, 2024Updated 2 years ago
- A stratified, semiring-parameterized Datalog and its reference engine — the symbolic core of a neuro-symbolic logic system. Bool/Trop sem…☆12Aug 15, 2026Updated 2 months ago
- high performance rendering engine , It does compile-time reactivity (JSX → SSA), uses ECS + SoA storage, runs a Zig/WASM core, and is fu…☆25Aug 8, 2026Updated 2 months ago
- Headless UI component library for Phoenix Liveview☆14Oct 14, 2026Updated 3 weeks ago
- PhonoGlyphe is a G2P transformer model meant as a fallback method for the Misaki G2P engine.☆10Feb 15, 2025Updated last year
- Quick tutorial showing how to fine-tune Llama3.1 with nothing but free tools and text data. All code included in ipynb. For a step by ste…☆10Aug 17, 2024Updated 2 years ago
- Learn how to build agents that can reason over their own documents☆14May 21, 2024Updated 2 years ago