Lightning-AI / litgptLinks
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
☆12,840Updated this week
Alternatives and similar repositories for litgpt
Users that are interested in litgpt are comparing it to the libraries listed below
Sorting:
- Go ahead and axolotl questions☆10,634Updated this week
- PyTorch native post-training library☆5,535Updated this week
- Tools for merging pretrained large language models.☆6,378Updated last month
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,938Updated last week
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,077Updated 3 months ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,768Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,697Updated last year
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,481Updated 7 months ago
- DSPy: The framework for programming—not prompting—language models☆29,294Updated this week
- Large Language Model Text Generation Inference☆10,566Updated last month
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,121Updated last month
- Robust recipes to align language models with human and AI preferences☆5,398Updated last month
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,070Updated last year
- ☆3,030Updated last year
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆19,832Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.☆47,063Updated this week
- A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)☆10,067Updated last year
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, o…☆8,841Updated this week
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆4,151Updated 3 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆7,647Updated 2 weeks ago
- Structured Outputs☆12,712Updated this week
- Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.☆18,781Updated last week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,840Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,484Updated 4 months ago
- Train transformer language models with reinforcement learning.☆15,818Updated last week
- Curated list of datasets and tools for post-training.☆3,777Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆46,375Updated 10 months ago
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,682Updated 3 weeks ago
- Official inference library for Mistral models☆10,506Updated 6 months ago
- Awesome-LLM: a curated list of Large Language Model☆25,250Updated 2 months ago