FareedKhan-dev / Building-llama3-from-scratchLinks
LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
☆169Updated 10 months ago
Alternatives and similar repositories for Building-llama3-from-scratch
Users that are interested in Building-llama3-from-scratch are comparing it to the libraries listed below
Sorting:
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆175Updated last year
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆128Updated last year
- Various installation guides for Large Language Models☆70Updated 2 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆324Updated 6 months ago
- LLM (Large Language Model) FineTuning☆542Updated 2 months ago
- Maximizing the Performance of a Simple RAG using RL☆62Updated 3 months ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆139Updated last year
- This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.☆306Updated 2 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆235Updated 10 months ago
- Notes and commented code for RLHF (PPO)☆96Updated last year
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆212Updated last week
- ☆144Updated 11 months ago
- Building LLaMA 4 MoE from Scratch☆53Updated 2 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆345Updated last year
- Training and Fine-tuning an llm in Python and PyTorch.☆42Updated last year
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆225Updated 7 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 9 months ago
- Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …☆60Updated last year
- How to build a Multi-Agentic Systems for RAG using LangGraph - Full project☆132Updated 5 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆124Updated last year
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆314Updated 3 weeks ago
- A pipeline for LLM knowledge distillation☆104Updated 2 months ago
- Notebook Examples used in machine learning writing and research☆76Updated last month
- Collection of resources for finetuning Large Language Models (LLMs).☆86Updated 5 months ago
- One click templates for inferencing Language Models☆190Updated last week
- ☆54Updated 4 months ago
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆64Updated 2 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆241Updated 2 weeks ago
- Simple examples using Argilla tools to build AI☆53Updated 7 months ago
- ☆73Updated 5 months ago