Alternatives and similar repositories for create-million-parameter-llm-from-scratch:

Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below

• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆157Updated 8 months ago
• ksm26 / Finetuning-Large-Language-Models
  Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …
  ☆56Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆213Updated 11 months ago
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆69Updated this week
• shivendrra / SmallLanguageModel
  a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
  ☆141Updated 9 months ago
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆32Updated last week
• FareedKhan-dev / rag-with-rl
  Maximizing the Performance of a Simple RAG using RL
  ☆55Updated last month
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆86Updated last year
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆530Updated 3 weeks ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆14Updated 8 months ago
• ChanCheeKean / DataScience
  ☆82Updated last year
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆126Updated last year
• lucifertrj / Awesome-RAG
  RAG-VectorDB-Embedings-LlamaIndex-Langchain
  ☆217Updated 4 months ago
• githubpradeep / notebooks
  ☆52Updated 2 months ago
• ALucek / LLM-distillation-guide
  ☆19Updated 8 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• FareedKhan-dev / text2video-from-scratch
  A Straightforward, Step-by-Step Implementation of a Video Diffusion Model
  ☆40Updated 2 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆106Updated 6 months ago
• TatevKaren / BabyGPT-Build_GPT_From_Scratch
  BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with …
  ☆81Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆202Updated last year
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆269Updated last year
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆52Updated 2 weeks ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆146Updated last year
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆31Updated 2 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆109Updated last week
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆28Updated 2 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 11 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆322Updated last year
• youssefHosni / Hands-On-LLM-Fine-Tuning
  Hands-on tutorials on fine-tuning various LLMs using different fine-tuning techniques
  ☆205Updated last week
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆59Updated last year