Alternatives and similar repositories for create-million-parameter-llm-from-scratch

Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below

• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆166Updated 9 months ago
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆60Updated 2 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆220Updated last year
• FareedKhan-dev / text2video-from-scratch
  A Straightforward, Step-by-Step Implementation of a Video Diffusion Model
  ☆45Updated 2 weeks ago
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆52Updated last month
• kabir2505 / tiny-mixtral
  ☆39Updated last month
• Blaizzy / Coding-LLMs-from-scratch
  ☆31Updated 11 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆122Updated last year
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆167Updated this week
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆69Updated last month
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆68Updated last year
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆41Updated last year
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆281Updated 2 years ago
• 1y33 / 100Days
  GPU Kernels
  ☆179Updated last month
• shivendrra / SmallLanguageModel
  a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
  ☆144Updated 11 months ago
• kmohan321 / LLMs
  ☆89Updated 2 months ago
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆32Updated 2 weeks ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆204Updated last year
• Danyalalam / LLM-from-scratch
  ☆32Updated 6 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆96Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• FareedKhan-dev / rag-with-rl
  Maximizing the Performance of a Simple RAG using RL
  ☆61Updated 2 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆106Updated 4 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆29Updated last year
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆61Updated last year
• NVIDIA / logits-processor-zoo
  A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
  ☆288Updated this week
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆105Updated last year
• markhliu / DGAI
  Learn Generative AI with PyTorch (Manning Publications, 2024)
  ☆100Updated 6 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆540Updated 2 months ago
• ChanCheeKean / DataScience
  ☆83Updated last year