Alternatives and similar repositories for FLASK

Users that are interested in FLASK are comparing it to the libraries listed below

• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆306Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆248Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆217Updated 2 years ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 4 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆244Updated 11 months ago
• lukasberglund / reversal_curse
  ☆296Updated last year
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆165Updated 2 years ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆163Updated last year
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆297Updated 8 months ago
• SALT-NLP / demonstrated-feedback
  ☆128Updated last year
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆56Updated last year
• bhargaviparanjape / language-programmes
  ☆173Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆135Updated last year
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆78Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆95Updated 2 years ago
• anthropics / ConstitutionalHarmlessnessPaper
  ☆242Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆88Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆218Updated 4 months ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• Lichang-Chen / InstructZero
  Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts…
  ☆196Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆127Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆226Updated 2 years ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆125Updated 2 years ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆250Updated 11 months ago
• FranxYao / GPT-Bargaining
  Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback
  ☆207Updated 2 years ago
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆57Updated 3 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 4 months ago
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆361Updated last year