Alternatives and similar repositories for create-million-parameter-llm-from-scratch:

Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below

• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆149Updated 7 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆516Updated 10 months ago
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆124Updated last year
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• TatevKaren / BabyGPT-Build_GPT_From_Scratch
  BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with …
  ☆77Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆205Updated 10 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• ChanCheeKean / DataScience
  ☆80Updated 11 months ago
• ALucek / LLM-distillation-guide
  ☆18Updated 7 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆59Updated 11 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆198Updated last year
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆41Updated 10 months ago
• Vaibhavs10 / gpu-poor-llm-notebooks
  ☆75Updated 5 months ago
• wenqiglantz / nvidia-sec-finetuning
  Fine-Tuning LLM and embedding models
  ☆27Updated last year
• broskicodes / slms
  Experimenting with small language models
  ☆64Updated last year
• shivendrra / SmallLanguageModel
  a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
  ☆138Updated 8 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆302Updated last month
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆257Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆105Updated 5 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆90Updated 10 months ago
• lucifertrj / Awesome-RAG
  RAG-VectorDB-Embedings-LlamaIndex-Langchain
  ☆214Updated 3 months ago
• mrmaheshrajput / recsys-llm-chatbot
  A LLM based chatbot Recommender engine
  ☆25Updated last year
• markhliu / DGAI
  Learn Generative AI with PyTorch (Manning Publications, 2024)
  ☆78Updated 3 months ago
• Praveen76 / LLMs-Interview-Prep-Guide
  Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…
  ☆126Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 10 months ago
• ananthanarayanan431 / Langchain-Projects-LLM
  Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…
  ☆96Updated 4 months ago
• hesamsheikh / llm-mechanics
  Coding an LLM and its building blocks from scratch.
  ☆17Updated last month