A practical, hands-on guide to building a small language model from scratch. Learn transformer architecture, attention mechanisms, and training techniques through step-by-step implementation with PyTorch.
☆23Dec 10, 2025Updated 10 months ago
Alternatives and similar repositories for Building-Small-Language-Model-from-Scratch-A-Practical-Guide-Book
Users that are interested in Building-Small-Language-Model-from-Scratch-A-Practical-Guide-Book are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data files and scripts for the ASU PHY494 class. Will be updated as we go along.☆11Jan 6, 2022Updated 4 years ago
- Python implementation for time series forecasting with SARIMAX/SARIMA models and hyperparameter tuning. Enhance your predictions!☆11Nov 7, 2023Updated 2 years ago
- Awesome-spatial-temporal-scientific-machine-learning-data-mining-packages. Julia and Python resources on spatial and temporal data mining…☆14Dec 3, 2022Updated 3 years ago
- ☆24Sep 20, 2025Updated last year
- OpenMDAO solvers and drivers to handle specific methods.☆12Jul 22, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Analyzes Symfony2 projets with PhpMetrics☆13Mar 22, 2016Updated 10 years ago
- Intuitive RAG system on top of LllamaIndex☆15Nov 8, 2024Updated last year
- A water wave and wave energy converter computation package☆15May 15, 2025Updated last year
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- ☆11Apr 26, 2022Updated 4 years ago
- PHPUnit cluster runner - opensourced☆12Mar 21, 2013Updated 13 years ago
- Inspired by autoresearch but for finance☆20Mar 17, 2026Updated 7 months ago
- 10+ hours of how to build AI products with local models☆22Apr 3, 2026Updated 6 months ago
- ⚡🏗️ template for new aws lambda serverless kinesis rust apps☆11Jun 1, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12Jun 29, 2017Updated 9 years ago
- WEC Design Optimization Toolbox☆21Oct 15, 2026Updated 2 weeks ago
- My setup for working with Vagrant, Ansible and Packer☆12Mar 26, 2014Updated 12 years ago
- Text Classifier for English as a Second Language Material☆14Jul 11, 2023Updated 3 years ago
- The repository implements a set of algorithms from the book "Methods in Computational Science", written by Johan Hoffman and published by…☆20Jan 10, 2025Updated last year
- Experimenting with different TensorFlow models and Rive State Machines for a Rive Creative Stream☆12Feb 22, 2023Updated 3 years ago
- How to build the best search, one step at a time!☆245Nov 27, 2025Updated 11 months ago
- Build Amazon Simple Queue Service (SQS) based applications without the boilerplate☆10Apr 6, 2023Updated 3 years ago
- ☆12Oct 13, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Webflow by Example, published by Packt☆13Jan 24, 2023Updated 3 years ago
- Embed anything.☆27May 24, 2024Updated 2 years ago
- Code to related to my NIPS 2016 paper☆10Dec 4, 2016Updated 9 years ago
- ☆14Oct 20, 2026Updated last week
- Python wrapper for the U.S. Energy Information Administration (EIA) API v2☆24Jun 2, 2025Updated last year
- ☆38Updated this week
- A static analysis tool that parses Go source code using Tree-sitter visualizing structs and interfaces relationships.☆13Apr 23, 2025Updated last year
- ☆14Jul 15, 2016Updated 10 years ago
- Automates steady and unsteady adjoints (general solvers and ODEs respectively). Forward and reverse mode algorithmic differentiation arou…☆29Apr 20, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for the book "Symbolic Computation with Python and SymPy"☆31Nov 30, 2025Updated 11 months ago
- ☆19Jun 9, 2023Updated 3 years ago
- UI toolkit to ease BoxyHQ integration☆17Oct 9, 2026Updated 3 weeks ago
- Python Bash emulation for agents, a port of vercel-labs/just-bash☆60Jun 4, 2026Updated 4 months ago
- Artifcial Intellgence Research paper☆10Mar 16, 2017Updated 9 years ago
- ☆15Apr 2, 2026Updated 6 months ago
- Multi-agent orchestration platform. Deploy any AI agent to any interface.☆26Mar 24, 2026Updated 7 months ago