Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
☆18,560May 19, 2026Updated 3 months ago
Alternatives and similar repositories for llama-cookbook
Users that are interested in llama-cookbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference code for Llama models☆59,599Jan 26, 2025Updated last year
- The official Meta Llama 3 GitHub site☆29,225Jan 26, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆91,352Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆74,673Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆75,940Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Train transformer language models with reinforcement learning.☆19,246Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆21,646Updated this week
- LlamaIndex is the leading document agent and OCR platform☆52,094Updated this week
- Inference code for CodeLlama models☆16,259Aug 12, 2024Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,527May 1, 2026Updated 4 months ago
- Open GenAI Stack☆8,426Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,655Updated this week
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆25,014Aug 12, 2024Updated 2 years ago
- Large Language Model Text Generation Inference☆10,889Mar 21, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- DSPy: The framework for programming—not prompting—language models☆37,879Updated this week
- LLM inference in C/C++☆127,616Updated this week
- A programming framework for agentic AI☆60,893Apr 15, 2026Updated 4 months ago
- The agent engineering platform.☆146,010Updated this week
- PyTorch native post-training library☆5,807Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆43,084Updated this week
- Robust recipes to align language models with human and AI preferences☆5,676May 26, 2026Updated 3 months ago
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,238Jul 17, 2024Updated 2 years ago
- Go ahead and axolotl questions☆12,458Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A framework for few-shot evaluation of language models.☆13,937Sep 1, 2026Updated last week
- Fast and memory-efficient exact attention☆24,868Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆62,940Nov 12, 2025Updated 9 months ago
- Agentic components of the Llama Stack APIs☆4,299Aug 5, 2025Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆11,011Jun 10, 2024Updated 2 years ago
- Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆180,516Updated this week
- Inference Llama 2 in one file of pure C☆20,066Aug 6, 2024Updated 2 years ago
- Examples and guides for using the OpenAI API☆75,865Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆165,036Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official inference library for Mistral models☆10,829Jun 16, 2026Updated 2 months ago
- Instruct-tune LLaMA on consumer hardware☆18,909Jul 29, 2024Updated 2 years ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,204Aug 26, 2026Updated 2 weeks ago
- Build, run, and manage agent platforms.☆42,114Updated this week
- A guidance language for controlling large language models.☆21,741May 21, 2026Updated 3 months ago
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆31,258Sep 30, 2025Updated 11 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,481Jun 7, 2025Updated last year