Alternatives and similar repositories for prometheus

Users that are interested in prometheus are comparing it to the libraries listed below

• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆216Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆242Updated last year
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆526Updated 11 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆453Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆206Updated this week
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆203Updated 5 months ago
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆345Updated last year
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆453Updated this week
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆198Updated last month
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆344Updated last year
• princeton-nlp / ALCE
  [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627
  ☆486Updated 7 months ago
• AI21Labs / in-context-ralm
  ☆280Updated last year
• catid / self-discover
  Implementation of Google's SELF-DISCOVER
  ☆294Updated 9 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆201Updated 3 weeks ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆265Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆212Updated last year
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆187Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆493Updated 4 months ago
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆224Updated 10 months ago
• AlexTMallen / adaptive-retrieval
  ☆175Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆120Updated 8 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆182Updated 5 months ago
• Re-Align / URIAL
  ☆309Updated 11 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆292Updated 3 months ago
• sabetAI / BLoRA
  batched loras
  ☆343Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆155Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆110Updated 8 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆281Updated 7 months ago