Alternatives and similar repositories for llama3:

Users that are interested in llama3 are comparing it to the libraries listed below

• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆42,344Updated this week
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆16,483Updated this week
• QwenLM / Qwen
  The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
  ☆17,494Updated 3 weeks ago
• QwenLM / Qwen2.5
  Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.
  ☆16,285Updated last week
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆21,922Updated 7 months ago
• meta-llama / llama
  Inference code for Llama models
  ☆57,912Updated last month
• meta-llama / codellama
  Inference code for CodeLlama models
  ☆16,246Updated 7 months ago
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆76,950Updated this week
• ollama / ollama
  Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
  ☆133,757Updated this week
• unslothai / unsloth
  Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥
  ☆35,466Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,196Updated 7 months ago
• hiyouga / LLaMA-Factory
  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
  ☆44,716Updated this week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,220Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,138Updated last week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆16,462Updated this week
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆12,220Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,169Updated 3 weeks ago
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆17,837Updated this week
• deepseek-ai / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models
  ☆16,816Updated last month
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,117Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆11,841Updated this week
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆40,273Updated this week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,846Updated this week
• hpcaitech / Open-Sora
  Open-Sora: Democratizing Efficient Video Production for All
  ☆25,569Updated this week
• deepseek-ai / DeepSeek-Coder
  DeepSeek Coder: Let the Code Write Itself
  ☆21,105Updated 10 months ago
• NVIDIA / TensorRT-LLM
  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain…
  ☆9,762Updated this week
• ollama / ollama-python
  Ollama Python library
  ☆7,013Updated this week
• ml-explore / mlx
  MLX: An array framework for Apple silicon
  ☆19,742Updated this week
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆40,237Updated 3 months ago