Alternatives and similar repositories for FLASK:

Users that are interested in FLASK are comparing it to the libraries listed below

• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆240Updated last year
• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆301Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 6 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated last year
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆192Updated 2 weeks ago
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆343Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆120Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆151Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆159Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆115Updated 7 months ago
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆87Updated last year
• SALT-NLP / demonstrated-feedback
  ☆120Updated 7 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated 2 years ago
• tianjunz / HIR
  ☆159Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆75Updated last year
• Lichang-Chen / InstructZero
  Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts…
  ☆195Updated 9 months ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆225Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆114Updated 5 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆161Updated this week
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆522Updated 3 months ago
• shuyanzhou / docprompting
  Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023
  ☆243Updated last year
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• wenhuchen / TheoremQA
  The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset
  ☆157Updated last year
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆284Updated 2 months ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆239Updated 6 months ago
• FranxYao / GPT-Bargaining
  Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback
  ☆206Updated last year