FareedKhan-dev / Building-llama3-from-scratchLinks
LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
☆171Updated 10 months ago
Alternatives and similar repositories for Building-llama3-from-scratch
Users that are interested in Building-llama3-from-scratch are comparing it to the libraries listed below
Sorting:
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆180Updated last year
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆311Updated this week
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆68Updated 3 months ago
- Collection of resources for finetuning Large Language Models (LLMs).☆91Updated 6 months ago
- ☆145Updated 11 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆128Updated last year
- Building LLaMA 4 MoE from Scratch☆56Updated 3 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆327Updated 6 months ago
- Banishing LLM Hallucinations Requires Rethinking Generalization☆276Updated last year
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆220Updated last month
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆235Updated 10 months ago
- Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs…☆439Updated 7 months ago
- ☆259Updated 3 weeks ago
- Maximizing the Performance of a Simple RAG using RL☆66Updated 3 months ago
- Various installation guides for Large Language Models☆71Updated 2 months ago
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆248Updated last month
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆229Updated 8 months ago
- ☆94Updated 3 months ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆142Updated last year
- Build datasets using natural language☆500Updated 2 months ago
- [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!☆423Updated 10 months ago
- A compact LLM pretrained in 9 days by using high quality data☆318Updated 3 months ago
- From scratch implementation of a vision language model in pure PyTorch☆227Updated last year
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆130Updated 8 months ago
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆34Updated last month
- This is the official repository for Auto-RAG.☆212Updated 2 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆353Updated last year
- Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"☆135Updated last year
- Ranking LLMs on agentic tasks☆148Updated 2 weeks ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆359Updated this week