declare-lab / flan-alpaca
This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.
☆351Updated last year
Alternatives and similar repositories for flan-alpaca:
Users that are interested in flan-alpaca are comparing it to the libraries listed below
- ☆457Updated last year
- This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations which is the most serious c…☆222Updated last year
- Reverse Instructions to generate instruction tuning data with corpus examples☆208Updated last year
- OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA☆301Updated last year
- ☆268Updated last year
- Tune any FALCON in 4-bit☆466Updated last year
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆184Updated last year
- ☆172Updated last year
- Code and data for "Measuring and Narrowing the Compositionality Gap in Language Models"☆310Updated last year
- 🥤🧑🏻🚀Code and dataset for our EMNLP 2023 paper - "SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization…☆226Updated last year
- Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)☆463Updated 2 years ago
- ☆178Updated 2 years ago
- batched loras☆338Updated last year
- Simple next-token-prediction for RLHF☆222Updated last year
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆81Updated last year
- Code for fine-tuning Platypus fam LLMs using LoRA☆628Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆161Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆233Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023☆241Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- A bagel, with everything.☆317Updated 11 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆298Updated last year
- Merge Transformers language models by use of gradient parameters.☆205Updated 7 months ago
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆542Updated last year
- TART: A plug-and-play Transformer module for task-agnostic reasoning☆195Updated last year
- ☆353Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆422Updated last year
- Used for adaptive human in the loop evaluation of language and embedding models.☆306Updated 2 years ago