huggingface / peftLinks
π€ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
β20,382Updated 2 weeks ago
Alternatives and similar repositories for peft
Users that are interested in peft are comparing it to the libraries listed below
Sorting:
- Train transformer language models with reinforcement learning.β16,844Updated this week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"β13,106Updated last year
- Fast and memory-efficient exact attentionβ21,401Updated this week
- Accessible large language models via k-bit quantization for PyTorch.β7,867Updated 3 weeks ago
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,415Updated 2 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMsβ10,805Updated last year
- Ongoing research training transformer models at scaleβ14,758Updated this week
- A framework for few-shot evaluation of language models.β11,069Updated last week
- Retrieval and Retrieval-augmented LLMsβ11,082Updated 2 weeks ago
- Large Language Model Text Generation Inferenceβ10,716Updated 2 weeks ago
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalitiesβ21,920Updated 3 weeks ago
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.β24,244Updated last year
- Transformer related optimization, including BERT, GPTβ6,376Updated last year
- Hackable and optimized Transformers building blocks, supporting a composable construction.β10,240Updated last week
- Aligning pretrained language models with instruction data generated by themselves.β4,556Updated 2 years ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)β¦β14,263Updated 2 weeks ago
- Example models using DeepSpeedβ6,750Updated 2 weeks ago
- LAVIS - A One-stop Library for Language-Vision Intelligenceβ11,102Updated last year
- An Easy-to-use, Scalable and High-performance RLHF Framework based on Ray (PPO & GRPO & REINFORCE++ & TIS & vLLM & Ray & Dynamic Samplingβ¦β8,692Updated 2 weeks ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β41,118Updated last week
- PyTorch native post-training libraryβ5,639Updated this week
- The official GitHub page for the survey paper "A Survey of Large Language Models".β12,043Updated 9 months ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)β4,738Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMsβ66,734Updated this week
- verl: Volcano Engine Reinforcement Learning for LLMsβ17,954Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)β64,621Updated last week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.β39,346Updated 7 months ago
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.β7,466Updated this week
- Instruct-tune LLaMA on consumer hardwareβ18,986Updated last year
- General technology for enabling AI capabilities w/ LLMs and MLLMsβ4,238Updated 2 weeks ago