Alternatives and similar repositories for generative-benchmarking

Users that are interested in generative-benchmarking are comparing it to the libraries listed below

• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆364Updated this week
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆316Updated last month
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆250Updated 9 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆289Updated last week
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆501Updated 2 months ago
• QuixiAI / spectrum
  ☆128Updated 3 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆282Updated 4 months ago
• quotient-ai / judges
  A small library of LLM judges
  ☆232Updated 3 weeks ago
• apple / ml-superposition-prompting
  ☆145Updated last year
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆288Updated last month
• neuml / annotateai
  📝 Automatically annotate papers using LLMs
  ☆332Updated 2 months ago
• writer / writing-in-the-margins
  ☆118Updated 10 months ago
• brandonstarxel / chunking_evaluation
  This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…
  ☆353Updated 4 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆218Updated this week
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆504Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆246Updated 4 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆107Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆432Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆173Updated 9 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆113Updated last week
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆132Updated last month
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆194Updated 2 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆251Updated this week
• adobe-research / dynasaur
  Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"
  ☆346Updated 6 months ago
• AnswerDotAI / fastdata
  ☆154Updated 7 months ago
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆260Updated 6 months ago
• jjovalle99 / raft-well-architected
  ☆20Updated last year
• huggingface / ai-blueprint
  A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …
  ☆54Updated 5 months ago