Alternatives and similar repositories for BLOOM-fine-tuning

Users that are interested in BLOOM-fine-tuning are comparing it to the libraries listed below

• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆185Updated 2 years ago
• ypeleg / llama
  User-friendly LLaMA: Train or Run the model using PyTorch. Nothing else.
  ☆338Updated 2 years ago
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆216Updated 4 years ago
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆538Updated 9 months ago
• feizc / MLE-LLaMA
  Multi-language Enhanced LLaMA
  ☆301Updated 2 years ago
• conceptofmind / LaMDA-rlhf-pytorch
  Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
  ☆471Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆352Updated 2 years ago
• mallorbc / Finetune_LLMs
  Repo for fine-tuning Casual LLMs
  ☆457Updated last year
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆200Updated last year
• icip-cas / ChatAlpaca
  A Multi-Turn Dialogue Corpus based on Alpaca Instructions
  ☆172Updated 2 years ago
• Shivanandroy / simpleT5
  simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.
  ☆395Updated 2 years ago
• salesforce / DialogStudio
  DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
  ☆508Updated 5 months ago
• airaria / TextPruner
  A PyTorch-based model pruning toolkit for pre-trained language models
  ☆387Updated last year
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆171Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated last year
• thisserand / alpaca-lora-finetune-language
  ☆122Updated 2 years ago
• lxe / llama-tune
  LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
  ☆51Updated 2 years ago
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆203Updated last year
• kongds / Prompt-BERT
  PromptBERT: Improving BERT Sentence Embeddings with Prompts
  ☆337Updated last year
• zsc / llama_infer
  Inference script for Meta's LLaMA models using Hugging Face wrapper
  ☆110Updated 2 years ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆314Updated 2 years ago
• jackaduma / Vicuna-LoRA-RLHF-PyTorch
  A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…
  ☆218Updated last year
• zphang / minimal-llama
  ☆458Updated last year
• google-research / longt5
  ☆182Updated 2 years ago
• henrywoo / minichatgpt
  minichatgpt - To Train ChatGPT In 5 Minutes
  ☆168Updated last year
• wxjiao / ParroT
  The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…
  ☆176Updated 6 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• ccdv-ai / convert_checkpoint_to_lsg
  Efficient Attention for Long Sequence Processing
  ☆95Updated last year
• yxuansu / OpenAlpaca
  OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA
  ☆302Updated 2 years ago