Alternatives and similar repositories for prometheus:

Users that are interested in prometheus are comparing it to the libraries listed below

• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆214Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆169Updated this week
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆497Updated 8 months ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆149Updated 3 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆441Updated 9 months ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆231Updated last year
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆405Updated last week
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆299Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆208Updated 11 months ago
• jzbjyb / FLARE
  Forward-Looking Active REtrieval-augmented generation (FLARE)
  ☆611Updated last year
• zorazrw / filco
  [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton
  ☆189Updated 10 months ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆128Updated last month
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆252Updated last year
• skywalker023 / sodaverse
  🥤🧑🏻‍🚀Code and dataset for our EMNLP 2023 paper - "SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization…
  ☆224Updated last year
• bhargaviparanjape / language-programmes
  ☆172Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• shizhediao / active-prompt
  Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"
  ☆233Updated 9 months ago
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆464Updated last month
• huggingface / cosmopedia
  ☆498Updated 3 months ago
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆333Updated last year
• AI21Labs / in-context-ralm
  ☆274Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 5 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆175Updated last month
• catid / self-discover
  Implementation of Google's SELF-DISCOVER
  ☆290Updated 6 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆164Updated 2 weeks ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆516Updated this week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆217Updated 4 months ago
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆599Updated last month
• freshllms / freshqa
  Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)
  ☆343Updated last week