Alternatives and similar repositories for alpaca-qlora

Users that are interested in alpaca-qlora are comparing it to the libraries listed below

• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆215Updated last year
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆137Updated 2 years ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆203Updated 2 years ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated 2 years ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆246Updated last year
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆93Updated 2 years ago
• nlpxucan / evol-instruct
  ☆273Updated 2 years ago
• hydrallm / llama-moe-v1
  ☆96Updated 2 years ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆103Updated 2 years ago
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆425Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated last year
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆201Updated last year
• kaistAI / SelFee
  Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"
  ☆229Updated 2 years ago
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆168Updated last year
• nickrosh / evol-teacher
  Open Source WizardCoder Dataset
  ☆161Updated 2 years ago
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆464Updated last year
• raunak-agarwal / instruction-datasets
  Datasets for Instruction Tuning of Large Language Models
  ☆257Updated last year
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated 2 years ago
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆184Updated 2 years ago
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆353Updated 2 years ago
• swj0419 / detect-pretrain-code-contamination
  ☆77Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆80Updated last year
• orhonovich / unnatural-instructions
  ☆180Updated 2 years ago
• jondurbin / bagel
  A bagel, with everything.
  ☆324Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆210Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆312Updated last year
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆116Updated 2 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 11 months ago
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆548Updated last year