Alternatives and similar repositories for Building-llama3-from-scratch

Users that are interested in Building-llama3-from-scratch are comparing it to the libraries listed below

• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆186Updated last year
• pdaicode / awesome-LLMs-finetuning
  Collection of resources for finetuning Large Language Models (LLMs).
  ☆101Updated 8 months ago
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆129Updated last year
• apple / ml-superposition-prompting
  ☆146Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆243Updated last year
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆73Updated 5 months ago
• ksm26 / Finetuning-Large-Language-Models
  Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …
  ☆68Updated last year
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆563Updated 6 months ago
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 2 months ago
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆72Updated 6 months ago
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆37Updated 4 months ago
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆213Updated 2 months ago
• FareedKhan-dev / rag-with-rl
  Maximizing the Performance of a Simple RAG using RL
  ☆81Updated 6 months ago
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆336Updated 9 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆228Updated last week
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆275Updated last year
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆64Updated 5 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 6 months ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆529Updated 3 weeks ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• lucifertrj / Awesome-RAG
  RAG-VectorDB-Embedings-LlamaIndex-Langchain
  ☆263Updated 3 weeks ago
• ibm-granite / granite-3.0-language-models
  ☆264Updated 3 months ago
• TIGER-AI-Lab / LongRAG
  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".
  ☆240Updated last year
• Curated-Awesome-Lists / awesome-llms-fine-tuning
  Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs…
  ☆473Updated 10 months ago
• ali-bahrainian / RAG_best_practices
  ☆95Updated 6 months ago
• shivendrra / SmallLanguageModel
  a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
  ☆159Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆240Updated 11 months ago
• kturung / colpali-llama-vision-rag
  ☆113Updated 10 months ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆134Updated last year
• llSourcell / O1-nano
  This is an open-source version of OpenAI's O1 Model Series by Siraj Raval & O1-Preview
  ☆96Updated 11 months ago