20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
☆13,228Mar 6, 2026Updated 2 weeks ago
Alternatives and similar repositories for litgpt
Users that are interested in litgpt are comparing it to the libraries listed below
Sorting:
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,082Jul 1, 2025Updated 8 months ago
- Go ahead and axolotl questions☆11,460Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆54,096Updated this week
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,911May 3, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆73,479Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,853Updated this week
- LlamaIndex is the leading document agent and OCR platform☆47,753Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,261Mar 3, 2026Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆55,030Nov 12, 2025Updated 4 months ago
- PyTorch native post-training library☆5,703Updated this week
- Large Language Model Text Generation Inference☆10,803Jan 8, 2026Updated 2 months ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆68,728Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆39,597Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,428Jun 2, 2025Updated 9 months ago
- Train transformer language models with reinforcement learning.☆17,697Updated this week
- Tools for merging pretrained large language models.☆6,867Updated this week
- A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.☆3,814Mar 2, 2026Updated 2 weeks ago
- Build, run, manage agentic software at scale.☆38,700Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,519Updated this week
- Universal memory layer for AI Agents☆50,147Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,765Mar 11, 2026Updated last week
- Structured Outputs☆13,564Mar 9, 2026Updated last week
- Implement a ChatGPT-like LLM in PyTorch from scratch, step by step☆88,603Mar 7, 2026Updated last week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,850Jun 10, 2024Updated last year
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,188Aug 22, 2025Updated 6 months ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,809Updated this week
- A programming framework for agentic AI☆55,559Mar 11, 2026Updated last week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆28,006Sep 30, 2025Updated 5 months ago
- Robust recipes to align language models with human and AI preferences☆5,527Sep 8, 2025Updated 6 months ago
- A guidance language for controlling large language models.☆21,346Updated this week
- Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.☆21,579Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,479Jun 7, 2025Updated 9 months ago
- An autonomous agent that conducts deep research on any data using any LLM providers☆25,718Updated this week
- Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data …☆11,368Jan 13, 2026Updated 2 months ago
- Fast and memory-efficient exact attention☆22,832Updated this week
- LLM inference in C/C++☆98,098Updated this week
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,578Aug 12, 2024Updated last year
- Universal LLM Deployment Engine with ML Compilation☆22,194Mar 9, 2026Updated last week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,807Updated this week