Alternatives and similar repositories for bench:

Users that are interested in bench are comparing it to the libraries listed below

• langchain-ai / auto-evaluator
  ☆767Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆421Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆320Updated 5 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆179Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆278Updated last week
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆582Updated last month
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆297Updated 5 months ago
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆582Updated this week
• texttron / hyde
  HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels
  ☆530Updated 4 months ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆329Updated 9 months ago
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆494Updated last year
• protectai / rebuff
  LLM Prompt Injection Detector
  ☆1,264Updated 8 months ago
• run-llama / ai-engineer-workshop
  ☆185Updated last year
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆907Updated 5 months ago
• jxnl / n-levels-of-rag
  ☆195Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆489Updated 3 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆237Updated 7 months ago
• BerriAI / reliableGPT
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
  ☆653Updated last year
• deepset-ai / prompthub
  ☆163Updated last year
• preset-io / promptimize
  Promptimize is a prompt engineering evaluation and testing toolkit.
  ☆460Updated last month
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆245Updated 6 months ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆263Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated last year
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆336Updated 5 months ago
• jamesmurdza / gitwit-agent
  Create repos and commits with AI.
  ☆293Updated last year
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆311Updated 2 months ago
• h2oai / h2o-wizardlm
  Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning
  ☆305Updated 6 months ago
• langchain-ai / text-split-explorer
  ☆259Updated last year
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆369Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆498Updated last year