FareedKhan-dev / Building-llama3-from-scratch
LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
☆157Updated 8 months ago
Alternatives and similar repositories for Building-llama3-from-scratch:
Users that are interested in Building-llama3-from-scratch are comparing it to the libraries listed below
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆158Updated 11 months ago
- Building LLaMA 4 MoE from Scratch☆32Updated last week
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆126Updated last year
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆52Updated 3 weeks ago
- Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …☆56Updated last year
- ☆143Updated 9 months ago
- From scratch implementation of a vision language model in pure PyTorch☆213Updated 11 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆230Updated 7 months ago
- Various installation guides for Large Language Models☆69Updated this week
- Collection of resources for finetuning Large Language Models (LLMs).☆73Updated 3 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆310Updated 4 months ago
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆31Updated 2 months ago
- Notes and commented code for RLHF (PPO)☆86Updated last year
- Let's discover films.☆24Updated 2 weeks ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆139Updated 10 months ago
- LLM (Large Language Model) FineTuning☆530Updated 3 weeks ago
- This is the official repository for Auto-RAG.☆206Updated 3 months ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆205Updated 5 months ago
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆294Updated 6 months ago
- ☆149Updated last week
- Notebook Examples used in machine learning writing and research☆66Updated 2 weeks ago
- [EMNLP 2024] LongRAG: A Dual-perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering☆102Updated 2 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 11 months ago
- Multimodal RAG using Langchain☆49Updated last year
- Vision-Augmented Retrieval and Generation (VARAG) - Vision first RAG Engine☆450Updated 3 months ago
- Maximizing the Performance of a Simple RAG using RL☆55Updated last month
- Fine tuning ModernBERT-embed-base on synthetic domain specific data for improvement to unseen queries☆27Updated 3 months ago
- a simplified version of Meta's Llama 3 model to be used for learning☆41Updated 11 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆217Updated 4 months ago
- RAFT, or Retrieval-Augmented Fine-Tuning, is a method comprising of a fine-tuning and a RAG-based retrieval phase. It is particularly sui…☆107Updated 7 months ago