Alternatives and similar repositories for bench

Users that are interested in bench are comparing it to the libraries listed below

• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆399Updated 2 years ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆323Updated 7 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆333Updated last year
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆975Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆295Updated 8 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆189Updated last year
• philschmid / easyllm
  ☆472Updated 2 years ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆264Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆446Updated last year
• langchain-ai / auto-evaluator
  ☆779Updated 7 months ago
• v7labs / benchllm
  Continuous Integration for LLM powered applications
  ☆254Updated 2 years ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆328Updated last year
• scaleapi / llm-engine
  Scale LLM Engine public repository
  ☆819Updated last week
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆255Updated last year
• wandb / wandbot
  wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk
  ☆309Updated 3 months ago
• georgian-io / LLM-Finetuning-Toolkit
  Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
  ☆869Updated last year
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆339Updated last year
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆734Updated 3 weeks ago
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆523Updated 2 years ago
• epfl-dlab / aiflows
  🤖🌊 aiFlows: The building blocks of your collaborative AI
  ☆272Updated last year
• rogeriochaves / langstream
  Build robust LLM applications with true composability 🔗
  ☆420Updated 2 years ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆248Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆517Updated last year
• run-llama / ai-engineer-workshop
  ☆187Updated 2 years ago
• preset-io / promptimize
  Promptimize is a prompt engineering evaluation and testing toolkit.
  ☆492Updated 3 weeks ago
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆511Updated 2 months ago
• ray-project / llmperf-leaderboard
  ☆476Updated 2 years ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆685Updated last year
• pchunduri6 / rag-demystified
  An LLM-powered advanced RAG pipeline built from scratch
  ☆856Updated 2 years ago
• h2oai / h2o-wizardlm
  Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning
  ☆309Updated last year