Alternatives and similar repositories for prometheus:

Users that are interested in prometheus are comparing it to the libraries listed below

• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆214Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆224Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆136Updated last month
• xfactlab / orpo
  Official repository for ORPO
  ☆432Updated 7 months ago
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆284Updated 11 months ago
• huggingface / cosmopedia
  ☆489Updated 2 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆210Updated 2 months ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆249Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆156Updated this week
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆201Updated last month
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆218Updated 8 months ago
• princeton-nlp / ALCE
  [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627
  ☆473Updated 3 months ago
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆492Updated 7 months ago
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆397Updated last week
• AI21Labs / in-context-ralm
  ☆269Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 4 months ago
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆327Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆315Updated 9 months ago
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆431Updated 11 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆124Updated 10 months ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆117Updated 3 weeks ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆168Updated 3 months ago
• jakespringer / echo-embeddings
  ☆138Updated 9 months ago
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆149Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆184Updated 2 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆494Updated this week
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆183Updated 11 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆173Updated 3 weeks ago