FareedKhan-dev / Building-llama3-from-scratchLinks
LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
☆166Updated 9 months ago
Alternatives and similar repositories for Building-llama3-from-scratch
Users that are interested in Building-llama3-from-scratch are comparing it to the libraries listed below
Sorting:
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆170Updated last year
- Maximizing the Performance of a Simple RAG using RL☆61Updated 2 months ago
- From scratch implementation of a vision language model in pure PyTorch☆220Updated last year
- Various installation guides for Large Language Models☆69Updated last month
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆60Updated 2 months ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆209Updated 2 weeks ago
- ☆92Updated 2 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆320Updated 5 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆125Updated last year
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆231Updated 9 months ago
- Building Data-Driven Applications with LlamaIndex, published by Packt☆91Updated last year
- How to build a Multi-Agentic Systems for RAG using LangGraph - Full project☆128Updated 4 months ago
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆32Updated 2 weeks ago
- a simplified version of Meta's Llama 3 model to be used for learning☆41Updated last year
- ☆257Updated 6 months ago
- Banishing LLM Hallucinations Requires Rethinking Generalization☆276Updated 10 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆221Updated 7 months ago
- This is the official repository for Auto-RAG.☆209Updated last month
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆299Updated 7 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆111Updated 8 months ago
- Notes and commented code for RLHF (PPO)☆96Updated last year
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆138Updated 11 months ago
- An Open Source Toolkit For LLM Distillation☆618Updated this week
- This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.☆305Updated 2 months ago
- ☆168Updated last month
- ☆113Updated 6 months ago
- Simple examples using Argilla tools to build AI☆53Updated 6 months ago
- This repository contains a pipeline for fine-tuning Large Language Models (LLMs) for Text-to-SQL conversion using General Reward Proximal…☆25Updated last month
- ☆75Updated 4 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆353Updated 9 months ago