FareedKhan-dev / create-million-parameter-llm-from-scratch
Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆111Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for create-million-parameter-llm-from-scratch
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆98Updated 2 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆119Updated 8 months ago
- Training and Fine-tuning an llm in Python and PyTorch.☆41Updated last year
- End-to-End LLM Guide☆97Updated 4 months ago
- Navigating the World of AI, One Step at a Time☆161Updated 2 weeks ago
- Distributed training (multi-node) of a Transformer model☆42Updated 7 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆238Updated 6 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation☆204Updated last month
- ☆28Updated 5 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆169Updated last month
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆173Updated last week
- Jupyter notebooks for course Building and Evaluating Advanced RAG Applications, taught by Jerry Liu (Co-founder and CEO of LlamaIndex) an…☆42Updated 9 months ago
- ☆41Updated 7 months ago
- 1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition☆147Updated 5 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆27Updated 10 months ago
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆162Updated 6 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 5 months ago
- a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model☆125Updated 4 months ago
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆76Updated 6 months ago
- Build your own Custom RAG Chatbot using Gradio, Langchain and Llama2☆57Updated 9 months ago
- Gemma2(9B), Llama3-8B-Finetune-and-RAG, code base for sample, implemented in Kaggle platform☆18Updated 4 months ago
- [EMNLP 2024] LongRAG: A Dual-perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering☆73Updated this week
- Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…☆96Updated 9 months ago
- RAFT, or Retrieval-Augmented Fine-Tuning, is a method comprising of a fine-tuning and a RAG-based retrieval phase. It is particularly sui…☆74Updated 2 months ago
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆74Updated last month
- Various installation guides for Large Language Models☆52Updated last month
- A set of scripts and notebooks on LLM finetunning and dataset creation☆92Updated last month
- LLMs in Finance - Generative AI - AI Agents☆176Updated this week
- Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…☆87Updated last month
- Question Answer Generation App using Mistral 7B, Langchain, and FastAPI.☆62Updated last year