Alternatives and similar repositories for FLASK:

Users that are interested in FLASK are comparing it to the libraries listed below

• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆300Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆237Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆224Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆186Updated last week
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆150Updated last year
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• AI21Labs / in-context-ralm
  ☆278Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 11 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆126Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆158Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆114Updated 7 months ago
• SALT-NLP / demonstrated-feedback
  ☆119Updated 6 months ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆257Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆169Updated 4 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆234Updated 5 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆338Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆122Updated 10 months ago
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆283Updated 2 months ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆209Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆118Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆301Updated 7 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• prateeky2806 / ties-merging
  ☆173Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆189Updated 3 weeks ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆74Updated last year
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆553Updated last month