Alternatives and similar repositories for generative-benchmarking

Users that are interested in generative-benchmarking are comparing it to the libraries listed below

• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆286Updated 11 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆62Updated 4 months ago
• quotient-ai / judges
  A small library of LLM judges
  ☆285Updated last month
• apple / ml-superposition-prompting
  ☆146Updated last year
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 4 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆116Updated 3 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆117Updated this week
• allenai / infinigram-api
  ☆81Updated this week
• writer / writing-in-the-margins
  ☆119Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• Pleias / RL-Reasoning
  Collection of resources for RL and Reasoning
  ☆26Updated 7 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆66Updated last year
• QuixiAI / spectrum
  ☆135Updated last month
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• huggingface / ai-blueprint
  A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …
  ☆59Updated 7 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆168Updated last week
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆297Updated 2 months ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆55Updated 7 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆197Updated 4 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆97Updated 9 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆85Updated 2 weeks ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆237Updated last month
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 7 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆112Updated last year
• menloresearch / ReZero
  ☆155Updated 5 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆291Updated 3 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year