linhduongtuan / BLOOM-LORA
Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigscience/license) using Alpaca-LoRA and Alpaca_data_cleaned.json
☆185Updated last year
Alternatives and similar repositories for BLOOM-LORA:
Users that are interested in BLOOM-LORA are comparing it to the libraries listed below
- Reverse Instructions to generate instruction tuning data with corpus examples☆208Updated 11 months ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆80Updated last year
- OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA☆301Updated last year
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆111Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- Crosslingual Generalization through Multitask Finetuning☆525Updated 4 months ago
- ☆456Updated last year
- ☆268Updated last year
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆226Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆242Updated last year
- This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…☆350Updated last year
- Unofficial implementation of AlpaGasus☆90Updated last year
- Official repository for LongChat and LongEval☆519Updated 8 months ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆215Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆172Updated last month
- Scripts for fine-tuning Llama2 via SFT and DPO.☆194Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆251Updated last year
- Multi-language Enhanced LLaMA☆301Updated last year
- Finetune BLOOM☆40Updated last year
- The data processing pipeline for the Koala chatbot language model☆117Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- ☆271Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆541Updated 11 months ago
- Code for fine-tuning Platypus fam LLMs using LoRA☆626Updated last year
- Tune any FALCON in 4-bit☆466Updated last year
- Implementation of Toolformer: Language Models Can Teach Themselves to Use Tools☆136Updated last year
- A minimum example of aligning language models with RLHF similar to ChatGPT☆217Updated last year
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆177Updated last year