Alternatives and similar repositories for prometheus

Users that are interested in prometheus are comparing it to the libraries listed below

• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆218Updated 2 years ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆254Updated 2 years ago
• xfactlab / orpo
  Official repository for ORPO
  ☆469Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆216Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆222Updated 2 years ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆165Updated 2 years ago
• naver / bergen
  Benchmarking library for RAG
  ☆255Updated last week
• skywalker023 / sodaverse
  🥤🧑🏻‍🚀Code and dataset for our EMNLP 2023 paper - "SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization…
  ☆238Updated 2 weeks ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆285Updated 2 years ago
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆407Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆130Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆120Updated 3 months ago
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆156Updated 2 years ago
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆208Updated 3 weeks ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 7 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆255Updated last year
• freshllms / freshqa
  Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)
  ☆386Updated 2 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆223Updated last year
• jakespringer / echo-embeddings
  ☆161Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆245Updated last year
• huggingface / cosmopedia
  ☆561Updated last year
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆232Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆280Updated last year
• bhargaviparanjape / language-programmes
  ☆173Updated 2 years ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆192Updated 6 months ago
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆142Updated 3 months ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆194Updated 5 months ago
• lukasberglund / reversal_curse
  ☆304Updated 2 years ago
• olly-styles / WorkBench
  WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.
  ☆62Updated last month