FareedKhan-dev / create-million-parameter-llm-from-scratchLinks
Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆197Updated last year
Alternatives and similar repositories for create-million-parameter-llm-from-scratch
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below
Sorting:
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆200Updated last year
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆77Updated 10 months ago
- LLM (Large Language Model) FineTuning☆565Updated 10 months ago
- A straightforward method for training your LLM, from downloading data to generating text.☆515Updated 6 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆277Updated 3 months ago
- Building LLaMA 4 MoE from Scratch☆72Updated 9 months ago
- a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model☆168Updated last year
- Various installation guides for Large Language Models☆77Updated 9 months ago
- Notebooks and Code about Generative Ai, LLMs, MLOPS, NLP , CV and Graph databases☆131Updated 3 weeks ago
- BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with …☆115Updated 2 years ago
- Collection of resources for finetuning Large Language Models (LLMs).☆111Updated last year
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆130Updated last year
- Maximizing the Performance of a Simple RAG using RL☆90Updated 10 months ago
- ☆89Updated 2 weeks ago
- From scratch implementation of a vision language model in pure PyTorch☆253Updated last year
- Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …☆68Updated 2 years ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 , A…☆104Updated last year
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆75Updated 5 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆116Updated last year
- Multimodal RAG using Langchain☆58Updated 2 years ago
- Composition of Multimodal Language Models From Scratch☆15Updated last year
- Learn Generative AI with PyTorch (Manning Publications, 2024)☆136Updated 8 months ago
- ☆93Updated this week
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated 2 years ago
- Simple introduction to LLM Agents☆140Updated last year
- Train a 29M parameter GPT from Scratch☆33Updated 11 months ago
- a simplified version of Meta's Llama 3 model to be used for learning☆44Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆120Updated 8 months ago
- META LLAMA3 GENAI Real World UseCases End To End Implementation Guide☆26Updated last year
- LLM Workshop by Sourab Mangrulkar☆401Updated last year