FareedKhan-dev / Building-llama3-from-scratch
LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
☆149Updated 7 months ago
Alternatives and similar repositories for Building-llama3-from-scratch:
Users that are interested in Building-llama3-from-scratch are comparing it to the libraries listed below
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆298Updated 3 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆124Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆151Updated 10 months ago
- ☆142Updated 8 months ago
- Banishing LLM Hallucinations Requires Rethinking Generalization☆272Updated 8 months ago
- Various installation guides for Large Language Models☆64Updated 4 months ago
- Local llamaindex RAG to assist researchers quickly navigate research papers☆99Updated 10 months ago
- Experimenting with small language models☆64Updated last year
- One click templates for inferencing Language Models☆165Updated this week
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆207Updated 4 months ago
- ☆254Updated 3 months ago
- awesome synthetic (text) datasets☆265Updated 4 months ago
- Beating the GAIA benchmark with Transformers Agents. 🚀☆103Updated last month
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆106Updated last month
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆338Updated 9 months ago
- RAFT, or Retrieval-Augmented Fine-Tuning, is a method comprising of a fine-tuning and a RAG-based retrieval phase. It is particularly sui…☆102Updated 6 months ago
- Training and Fine-tuning an llm in Python and PyTorch.☆41Updated last year
- a simplified version of Meta's Llama 3 model to be used for learning☆41Updated 10 months ago
- From scratch implementation of a vision language model in pure PyTorch☆205Updated 10 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆124Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆105Updated 5 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆227Updated 6 months ago
- This is the official repository for Auto-RAG.☆201Updated 2 months ago
- Sample notebooks and prompts for LLM evaluation☆123Updated 3 months ago
- ☆41Updated last year
- Collection of resources for finetuning Large Language Models (LLMs).☆61Updated 2 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆352Updated 3 months ago
- ☆48Updated this week
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆349Updated 6 months ago