Alternatives and similar repositories for create-million-parameter-llm-from-scratch

Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below

• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆169Updated 10 months ago
• FareedKhan-dev / rag-with-rl
  Maximizing the Performance of a Simple RAG using RL
  ☆62Updated 3 months ago
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆53Updated 2 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆225Updated last year
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆64Updated 2 months ago
• kabir2505 / tiny-mixtral
  ☆41Updated last month
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• youssefHosni / Hands-On-LLM-Fine-Tuning
  Hands-on tutorials on fine-tuning various LLMs using different fine-tuning techniques
  ☆236Updated last week
• FareedKhan-dev / train-llm-from-scratch
  A straightforward method for training your LLM, from downloading data to generating text.
  ☆376Updated last month
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆70Updated 2 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆182Updated 2 months ago
• hkproj / multi-latent-attention
  ☆39Updated last month
• kmohan321 / LLMs
  ☆89Updated 2 months ago
• ChanCheeKean / DataScience
  ☆83Updated last year
• FareedKhan-dev / text2video-from-scratch
  A Straightforward, Step-by-Step Implementation of a Video Diffusion Model
  ☆47Updated last month
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆128Updated last year
• ananthanarayanan431 / Langchain-Projects-LLM
  Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…
  ☆97Updated 7 months ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆14Updated 10 months ago
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆32Updated last month
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆281Updated last week
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆542Updated 2 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆96Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 3 months ago
• hesamsheikh / llm-mechanics
  Coding an LLM and its building blocks from scratch.
  ☆39Updated 3 months ago
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆41Updated last year
• ksm26 / Finetuning-Large-Language-Models
  Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …
  ☆60Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 9 months ago
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆314Updated 2 months ago
• FareedKhan-dev / Understanding-Transformers-Step-by-Step-math-example
  Understanding Large Language Transformer Architecture like a child
  ☆22Updated last year
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆62Updated last year