Alternatives and similar repositories for benchllm

Users that are interested in benchllm are comparing it to the libraries listed below

• arthur-ai / bench
  A tool for evaluating LLMs
  ☆424Updated last year
• deepset-ai / prompthub
  ☆177Updated last year
• timho102003 / NewsGPT
  ☆223Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆328Updated 10 months ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆318Updated 2 months ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆264Updated last year
• epfl-dlab / aiflows
  🤖🌊 aiFlows: The building blocks of your collaborative AI
  ☆273Updated last year
• felixbrock / lemon-agent
  Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation
  ☆344Updated 2 years ago
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆83Updated last year
• jxnl / n-levels-of-rag
  ☆196Updated last year
• run-llama / ai-engineer-workshop
  ☆186Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated 11 months ago
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆339Updated 10 months ago
• BerriAI / bettertest
  ☆75Updated last year
• seanchatmangpt / dspygen
  A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
  ☆130Updated 11 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆248Updated 11 months ago
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆239Updated 2 years ago
• Pan-ML / panml
  PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
  ☆117Updated 2 years ago
• tg1482 / priomptipy
  A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.
  ☆112Updated 2 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆79Updated 7 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆252Updated 11 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆98Updated 7 months ago
• genlayerlabs / genworlds
  A framework for event based autonomous multi-agent systems.
  ☆303Updated last year
• langwatch / langevals
  LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…
  ☆65Updated 2 weeks ago
• langchain-ai / kork
  Natural Language Interfaces Powered by LLMs
  ☆94Updated last year
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆387Updated last year
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆399Updated last year
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆285Updated last year
• deepset-ai / haystack-integrations
  🚀 A list of Haystack Integrations, maintained by the community or deepset.
  ☆96Updated last week
• shroominic / fastui-chat
  💬 minimalistic ChatBot Interface in pure python
  ☆225Updated last year