FareedKhan-dev / create-million-parameter-llm-from-scratch
Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆124Updated 8 months ago
Alternatives and similar repositories for create-million-parameter-llm-from-scratch:
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆127Updated 4 months ago
- From scratch implementation of a vision language model in pure PyTorch☆189Updated 8 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆121Updated 10 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆194Updated last month
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- ☆77Updated 9 months ago
- Training and Fine-tuning an llm in Python and PyTorch.☆41Updated last year
- a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model☆131Updated 6 months ago
- Scripts, notebooks, and articles about data science in general.☆45Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 7 months ago
- Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …☆49Updated last year
- Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.☆63Updated last year
- Notebooks and code with some RAG techniques using llamaindex☆24Updated 9 months ago
- LLM (Large Language Model) FineTuning☆491Updated 8 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆272Updated 8 months ago
- ☆29Updated 7 months ago
- LoRA and DoRA from Scratch Implementations☆194Updated 10 months ago
- ☆50Updated 3 weeks ago
- Awesome LLM application repo☆62Updated 2 months ago
- ☆96Updated last month
- ☆95Updated 2 weeks ago
- BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with …☆68Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆92Updated last year
- Various installation guides for Large Language Models☆62Updated 2 months ago
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆141Updated 9 months ago
- Chainlit app for advanced RAG. Uses llamaparse, langchain, qdrant and models from groq.☆40Updated 7 months ago
- A repository of Python scripts to scrape code contents of the public repositories of `huggingface`.☆46Updated 10 months ago
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆236Updated last year
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆164Updated 8 months ago
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆76Updated this week