Alternatives and similar repositories for train-llm-from-scratch

Users that are interested in train-llm-from-scratch are comparing it to the libraries listed below

• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆196Updated last year
• andysingal / llm-course
  ☆722Updated last week
• FareedKhan-dev / train-deepseek-r1
  Building DeepSeek R1 from Scratch
  ☆742Updated 10 months ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆197Updated last year
• Curated-Awesome-Lists / awesome-llms-fine-tuning
  Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs…
  ☆499Updated last year
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆76Updated 9 months ago
• liyuan24 / nanoDeepResearch
  A Deep Research agent from scratch
  ☆214Updated 8 months ago
• JohnMachado11 / Build-a-Large-Language-Model-from-Scratch
  Building a GPT-like LLM from scratch with PyTorch.
  ☆330Updated last year
• FareedKhan-dev / rag-with-rl
  Maximizing the Performance of a Simple RAG using RL
  ☆90Updated 10 months ago
• attentionmech / mav
  Model Activity Visualiser
  ☆520Updated 9 months ago
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆72Updated 9 months ago
• FareedKhan-dev / KG-Pipeline
  Converting Unstructured Data to a Knowledge Graph: An End-to-End Pipeline
  ☆290Updated 9 months ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆559Updated 4 months ago
• hhy-huang / HiRAG
  [EMNLP'25 findings] This is the official repo for the paper, HiRAG: Retrieval-Augmented Generation with Hierarchical Knowledge.
  ☆497Updated 2 months ago
• FareedKhan-dev / complex-RAG-guide
  A step by step implementation of a complex RAG pipeline to solve real world situations
  ☆395Updated 6 months ago
• EternityJune25 / ComoRAG
  [AAAI 2026 🔥 Poster] ComoRAG: A Cognitive-Inspired Memory-Organized RAG for Stateful Long Narrative Reasoning
  ☆317Updated 4 months ago
• glacier-creative-git / similarity-graph-traversal-semantic-rag-research
  Completed research on semantic retrieval augmented generation through novel semantic similarity graph traversal algorithms.
  ☆266Updated 2 months ago
• KRLabsOrg / LettuceDetect
  LettuceDetect is a hallucination detection framework for RAG applications.
  ☆527Updated 4 months ago
• simulanics / REFRAG
  REFRAG-style RAG (compress → sense/select → expand) — Single-file reference implementation
  ☆203Updated 3 weeks ago
• NisaarAgharia / Advanced_RAG
  Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…
  ☆439Updated last year
• anakin87 / qwen-scheduler-grpo
  Train a Language Model with GRPO to create a schedule from a list of events and priorities
  ☆259Updated 8 months ago
• apatti / AIEBootcamp
  AI Engineering bootcamp
  ☆106Updated 10 months ago
• dCaples / AutoDidact
  Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.
  ☆680Updated 10 months ago
• pdaicode / awesome-LLMs-finetuning
  Collection of resources for finetuning Large Language Models (LLMs).
  ☆110Updated last year
• GabrieleSgroi / multiagentic_rag
  ☆78Updated last year
• swirl-ai / ai-angineers-handbook
  ☆659Updated 10 months ago
• AstraBert / llama-4-researcher
  Turn topics into essays in seconds!
  ☆191Updated 6 months ago
• lucifertrj / Awesome-RAG
  RAG-VectorDB-Embedings-LlamaIndex-Langchain
  ☆277Updated 3 months ago
• landing-ai / vision-agent-tools
  ☆43Updated last week
• harishsg993010 / LLM-Reasoner
  Make any LLM to think like OpenAI o1 and deepseek R1
  ☆491Updated 11 months ago