akoksal / LongForm
Reverse Instructions to generate instruction tuning data with corpus examples
☆208Updated 11 months ago
Alternatives and similar repositories for LongForm:
Users that are interested in LongForm are comparing it to the libraries listed below
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆218Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆242Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- Scalable training for dense retrieval models.☆275Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆229Updated last year
- ☆177Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆113Updated 5 months ago
- ☆271Updated last year
- Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…☆185Updated last year
- DSIR large-scale data selection framework for language model training☆241Updated 10 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Simple next-token-prediction for RLHF☆222Updated last year
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- Multipack distributed sampler for fast padding-free training of LLMs☆184Updated 6 months ago
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆157Updated 9 months ago
- ☆160Updated last year
- Code for ACL2023 paper: Pre-Training to Learn in Context☆108Updated 6 months ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆107Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆251Updated last year
- TART: A plug-and-play Transformer module for task-agnostic reasoning☆195Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆175Updated last month
- Code repository for the c-BTM paper☆105Updated last year
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆93Updated last year
- Scaling Data-Constrained Language Models☆333Updated 4 months ago
- Self-Alignment with Principle-Following Reward Models☆154Updated 11 months ago
- Inquisitive Parrots for Search☆186Updated 11 months ago
- ☆124Updated last month