FareedKhan-dev / create-million-parameter-llm-from-scratch
Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆112Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for create-million-parameter-llm-from-scratch
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆104Updated 2 months ago
- From scratch implementation of a vision language model in pure PyTorch☆162Updated 6 months ago
- End-to-End LLM Guide☆97Updated 4 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆27Updated 10 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆170Updated 2 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆53Updated 2 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation☆215Updated last month
- 1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition☆150Updated 6 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆240Updated 6 months ago
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆76Updated last month
- Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …☆45Updated last year
- ☆19Updated last week
- This project is a **proof of concept** that aims to replicate the reasoning capabilities of OpenAI's newly released O1 model.☆76Updated 2 months ago
- ☆29Updated 5 months ago
- ☆49Updated this week
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆175Updated 2 weeks ago
- GenAI Experimentation☆58Updated 2 months ago
- ☆75Updated 7 months ago
- A compact LLM pretrained in 9 days by using high quality data☆262Updated last month
- A set of scripts and notebooks on LLM finetunning and dataset creation☆93Updated last month
- An open source implementation of LFMs from Liquid AI: Liquid Foundation Models☆72Updated last month
- Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…☆98Updated 9 months ago
- Notebooks and code with some RAG techniques using llamaindex☆25Updated 7 months ago
- ☆368Updated this week
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆226Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆82Updated last year
- Gen AI Large Language Model Projects☆40Updated 6 months ago
- Navigating the World of AI, One Step at a Time☆168Updated 3 weeks ago
- LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.☆68Updated 10 months ago
- Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.☆63Updated last year