Alternatives and similar repositories for llama3:

Users that are interested in llama3 are comparing it to the libraries listed below

• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆299Updated last year
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆264Updated last month
• hkproj / pytorch-paligemma
  Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation: https://www.youtube.com/watch?v=vAmKB7iPkWw
  ☆411Updated 3 months ago
• hengjiUSTC / learn-llm
  ☆104Updated 3 months ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆62Updated last year
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆286Updated 10 months ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆392Updated 4 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆198Updated last year
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆136Updated last month
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆140Updated last week
• hkproj / triton-flash-attention
  ☆130Updated 2 months ago
• timinar / BabyLlama
  Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.
  ☆78Updated last year
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆362Updated 3 weeks ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆72Updated last year
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆114Updated last week
• xfactlab / orpo
  Official repository for ORPO
  ☆443Updated 9 months ago
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆53Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆348Updated 6 months ago
• catid / dora
  Implementation of DoRA
  ☆290Updated 9 months ago
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆51Updated 6 months ago
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆800Updated 3 months ago
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆50Updated 4 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆155Updated this week
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆328Updated 3 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆196Updated 2 months ago