Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
β13,264Dec 17, 2024Updated last year
Alternatives and similar repositories for LoRA
Users that are interested in LoRA are comparing it to the libraries listed below
Sorting:
- π€ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.β20,678Updated this week
- Fast and memory-efficient exact attentionβ22,361Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β41,648Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMsβ10,838Jun 10, 2024Updated last year
- Inference code for Llama modelsβ59,166Jan 26, 2025Updated last year
- CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an imageβ32,642Feb 18, 2026Updated last week
- Accessible large language models via k-bit quantization for PyTorch.β7,997Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.β30,271Jul 17, 2024Updated last year
- Train transformer language models with reinforcement learning.β17,460Updated this week
- Using Low-rank adaptation to quickly fine-tune diffusion models.β7,525Mar 22, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMsβ71,234Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalitiesβ22,033Jan 23, 2026Updated last month
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.β24,478Aug 12, 2024Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.β39,414Jun 2, 2025Updated 8 months ago
- Ongoing research training transformer models at scaleβ15,242Updated this week
- Instruct-tune LLaMA on consumer hardwareβ18,970Jul 29, 2024Updated last year
- π€ Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.β32,873Updated this week
- π€ Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal modelβ¦β157,071Updated this week
- Hackable and optimized Transformers building blocks, supporting a composable construction.β10,353Feb 20, 2026Updated last week
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,513Updated this week
- Let us control diffusion models!β33,663Feb 25, 2024Updated 2 years ago
- An open source implementation of CLIP.β13,397Feb 20, 2026Updated last week
- The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoiβ¦β53,497Sep 18, 2024Updated last year
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)β67,415Feb 20, 2026Updated last week
- LAVIS - A One-stop Library for Language-Vision Intelligenceβ11,167Nov 18, 2024Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parametersβ5,936Mar 14, 2024Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.β32,159Sep 30, 2025Updated 4 months ago
- Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"β8,382May 31, 2024Updated last year
- Mamba SSM architectureβ17,257Feb 18, 2026Updated last week
- π¦π The platform for reliable agents.β127,192Updated this week
- Making large AI models cheaper, faster and more accessibleβ41,359Updated this week
- A library for efficient similarity search and clustering of dense vectors.β39,195Updated this week
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)β¦β14,375Updated this week
- Transformer related optimization, including BERT, GPTβ6,394Mar 27, 2024Updated last year
- SGLang is a high-performance serving framework for large language models and multimodal models.β23,658Updated this week
- LLM inference in C/C++β95,726Updated this week
- LlamaIndex is the leading document agent and OCR platformβ47,210Updated this week
- A latent text-to-image diffusion modelβ72,575Jun 18, 2024Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β53,743Nov 12, 2025Updated 3 months ago