FareedKhan-dev / create-million-parameter-llm-from-scratch
Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆141Updated 9 months ago
Alternatives and similar repositories for create-million-parameter-llm-from-scratch:
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆142Updated 5 months ago
- From scratch implementation of a vision language model in pure PyTorch☆194Updated 9 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆204Updated 2 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆121Updated 11 months ago
- Training and Fine-tuning an llm in Python and PyTorch.☆41Updated last year
- A RAG based Generative AI Attorney fed with Indian Penal Code data. Developed using Streamlit, LangChain and TogetherAI API.☆47Updated 9 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆283Updated 9 months ago
- BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with …☆75Updated last year
- LLM Engineering CrashCourse☆99Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 8 months ago
- LLaMA 2 implemented from scratch in PyTorch☆294Updated last year
- End-to-End LLM Guide☆101Updated 7 months ago
- CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion☆40Updated last year
- Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…☆93Updated 2 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆103Updated 4 months ago
- ☆78Updated 10 months ago
- Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…☆122Updated last year
- ☆52Updated last week
- Distributed training (multi-node) of a Transformer model☆54Updated 10 months ago
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆251Updated last year
- Notes and commented code for RLHF (PPO)☆69Updated 11 months ago
- A compact LLM pretrained in 9 days by using high quality data☆292Updated 2 months ago
- ☆15Updated last year
- Complete example of how to build an Agentic RAG architecture with Redis, Amazon Bedrock, and LlamaIndex.☆91Updated 2 months ago
- Llama 3 ORPO Fine Tuning on A100 in Colab Pro.☆11Updated 10 months ago
- LLM (Large Language Model) FineTuning☆506Updated 9 months ago
- a simplified version of Google's Gemma model to be used for learning☆24Updated 11 months ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆141Updated 10 months ago
- a simplified version of Meta's Llama 3 model to be used for learning☆39Updated 9 months ago