Alternatives and similar repositories for bench:

Users that are interested in bench are comparing it to the libraries listed below

• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆253Updated last week
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆174Updated 10 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆236Updated 2 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆313Updated 2 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆526Updated 2 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆401Updated 11 months ago
• langchain-ai / auto-evaluator
  ☆754Updated last year
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆276Updated 2 months ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆328Updated 5 months ago
• LudwigStumpp / llm-leaderboard
  A joint community effort to create one central leaderboard for LLMs.
  ☆288Updated 4 months ago
• yeagerai / genworlds
  A framework for event based autonomous multi-agent systems.
  ☆299Updated 4 months ago
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆262Updated 4 months ago
• run-llama / ai-engineer-workshop
  ☆184Updated last year
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆540Updated this week
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆866Updated last month
• deepset-ai / prompthub
  ☆154Updated last year
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆477Updated last year
• philschmid / easyllm
  ☆440Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆170Updated 5 months ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆254Updated this week
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆262Updated 9 months ago
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆328Updated last month
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆119Updated last month
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆233Updated 3 months ago
• HazyResearch / evaporate
  This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…
  ☆484Updated 9 months ago
• langchain-ai / langsmith-sdk
  LangSmith Client SDK Implementations
  ☆457Updated this week
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆463Updated last week
• jamesmurdza / gitwit-agent
  Create repos and commits with AI.
  ☆293Updated last year
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆183Updated last year