Alternatives and similar repositories for generative-benchmarking

Users that are interested in generative-benchmarking are comparing it to the libraries listed below

• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆296Updated last year
• Pleias / RL-Reasoning
  Collection of resources for RL and Reasoning
  ☆26Updated 9 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆170Updated last week
• quotient-ai / judges
  A small library of LLM judges
  ☆299Updated 3 months ago
• huggingface / ai-blueprint
  A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …
  ☆61Updated 9 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆64Updated 6 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆305Updated 4 months ago
• QuixiAI / spectrum
  ☆138Updated 2 months ago
• apple / ml-superposition-prompting
  ☆146Updated last year
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆411Updated last month
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆69Updated last year
• writer / writing-in-the-margins
  ☆119Updated last year
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 6 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated 11 months ago
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆121Updated last week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆263Updated 10 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆298Updated 5 months ago
• zeroentropy-ai / legalbenchrag
  This is the repo for the LegalBench-RAG Paper: https://arxiv.org/abs/2408.10343.
  ☆136Updated 5 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆121Updated 4 months ago
• AnswerDotAI / fastdata
  ☆159Updated 11 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 3 months ago
• PrimeIntellect-ai / genesys
  ☆135Updated 7 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆242Updated 3 weeks ago
• Liyan06 / MiniCheck
  MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
  ☆187Updated 2 months ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆164Updated 4 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆199Updated 5 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆119Updated last year