Alternatives and similar repositories for FLASK

Users that are interested in FLASK are comparing it to the libraries listed below

• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆306Updated 2 years ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆248Updated 2 years ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆217Updated 2 years ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 4 months ago
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆163Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆244Updated last year
• lukasberglund / reversal_curse
  ☆297Updated 2 years ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆165Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆252Updated last year
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆56Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆89Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆126Updated 2 years ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆219Updated 5 months ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆226Updated 2 years ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• anthropics / ConstitutionalHarmlessnessPaper
  ☆246Updated 2 years ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆167Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆135Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆127Updated 11 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆164Updated last year
• tianjunz / HIR
  ☆159Updated 2 years ago
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆299Updated 9 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• bhargaviparanjape / language-programmes
  ☆173Updated 2 years ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆117Updated 2 years ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆83Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆110Updated 5 months ago