Alternatives and similar repositories for bench:

Users that are interested in bench are comparing it to the libraries listed below

• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆406Updated last year
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆547Updated 3 months ago
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆557Updated this week
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆175Updated 11 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆266Updated this week
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆329Updated 6 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆313Updated 3 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆239Updated 3 months ago
• philschmid / easyllm
  ☆446Updated last year
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆483Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆495Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆476Updated 3 weeks ago
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆145Updated 10 months ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆283Updated 3 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆590Updated 9 months ago
• deepset-ai / prompthub
  ☆157Updated last year
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆389Updated last year
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆331Updated 3 months ago
• langchain-ai / auto-evaluator
  ☆756Updated last year
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆492Updated 7 months ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆262Updated 11 months ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆297Updated this week
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆393Updated last month
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆234Updated last year
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆470Updated 9 months ago
• yeagerai / genworlds
  A framework for event based autonomous multi-agent systems.
  ☆300Updated 5 months ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆183Updated last year
• allenai / lumos
  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"
  ☆462Updated 11 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆236Updated 4 months ago
• ray-project / llmperf-leaderboard
  ☆448Updated last year