A practical, step-by-step guide to building and training a Large Language Model from scratch, from data collection and tokenization to transformer architecture, model training, and text generation.
☆14Oct 31, 2026Updated last week
Alternatives and similar repositories for building-llms-from-scratch
Users that are interested in building-llms-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The PyTorch for Deep Learning Professional Certificate from DeepLearning.AI teaches you how to build, train, optimize, and deploy deep le…☆10Sep 7, 2026Updated 2 months ago
- Free Flow automatically connects you to the BEST + FREE LLMs so you can stop juggling API keys, rate limits and kidney sales so you can s…☆12Jun 11, 2025Updated last year
- Git Cheat Sheet for you all☆13Feb 7, 2023Updated 3 years ago
- A free course on machine learning for cybersecurity and the security of machine learning, with lessons, runnable labs, exercises and quiz…☆23Oct 16, 2026Updated 3 weeks ago
- ☆14Jan 9, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [COLM 2026] From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement☆16Jul 26, 2026Updated 3 months ago
- ☆24Jun 25, 2026Updated 4 months ago
- ☆15Sep 2, 2025Updated last year
- ClickSafe enhances your online security by analyzing links on the current webpage. When protection is enabled, ClickSafe will notif…☆14Jul 5, 2025Updated last year
- ☆12Jan 25, 2025Updated last year
- AVS is a static application security testing (SAST) tool for detecting common and high-impact vulnerabilities in Android applications.☆23Jan 8, 2026Updated 10 months ago
- offsec-ai is a Python library and CLI that combines classic network reconnaissance with modern AI/LLM security testing.☆34Oct 10, 2026Updated last month
- 🤖 Real-World AI Interview Questions for You!☆18Jan 3, 2024Updated 2 years ago
- CMU 15-418/15-618 Parallel Computer Architecture and Programming☆11Oct 23, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Increasingly complete example bioinformatics workflow☆18Oct 19, 2022Updated 4 years ago
- The system that is designed to assist in verifying the authenticity of Nepali documents (Citizenship, Driving License, Passport) against …☆18May 2, 2025Updated last year
- Python Scraper to scrape all the data from nepse.☆23Dec 5, 2025Updated 11 months ago
- ☆38Nov 2, 2026Updated last week
- ☆15Mar 11, 2026Updated 8 months ago
- Multithreaded implementation of the partitioned hash join algorithm for an in-memory columnar database☆14Sep 18, 2023Updated 3 years ago
- A mini deep learning framework☆14Feb 15, 2023Updated 3 years ago
- ☆14Jan 4, 2022Updated 4 years ago
- This a repo to learn langchain from basics to advance.☆44Sep 16, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An overview talk on good (not necessarily best) practices for research software engineering☆21Jan 15, 2024Updated 2 years ago
- An open-source project that uses cutting-edge NLP models and real-time web search to provide dynamic voice query responses. Features incl…☆20May 24, 2024Updated 2 years ago
- Open-source penetration test report writing tool. Write, manage, and export professional pentest reports — fast.☆29Mar 8, 2026Updated 8 months ago
- ☆18Sep 7, 2026Updated 2 months ago
- From-scratch multi-GPU LLM inference engine: paged KV cache, continuous batching, prefix caching, tensor parallelism, OpenAI-compatible s…☆28Sep 25, 2026Updated last month
- This repo contains all the code to do the fine tuning with LoRA of a small LLM☆21Updated this week
- A simple drawing board application where you can draw something☆15May 7, 2021Updated 5 years ago
- ☆30Updated this week
- Ultra-lightweight AI agent framework. Shannon Entropy routing, zero-trust sandbox, GraphRAG memory. Only 2 dependencies.☆21Mar 2, 2026Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆18Jul 12, 2025Updated last year
- ☆37Jan 11, 2026Updated 10 months ago
- Boiler plate repo to build an end-to-end ML project☆34May 28, 2026Updated 5 months ago
- Scripts for finetuning m2m-100 models☆19Jul 28, 2022Updated 4 years ago
- These cheat sheets have recently been re-designed into Super High-Resolution PDF. These cheat sheets are very helpful as a quick referenc…☆37Jun 5, 2023Updated 3 years ago
- Interactive tutorial on the Forward-Backward Expectation Maximization algorithm☆32Dec 15, 2015Updated 10 years ago
- A Model Context Protocol server that provides package index querying capabilities.☆11Oct 25, 2026Updated 2 weeks ago
Are these results useful?