Alternatives and similar repositories for benchllm

Users that are interested in benchllm are comparing it to the libraries listed below

• arthur-ai / bench
  A tool for evaluating LLMs
  ☆428Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆156Updated last year
• timho102003 / NewsGPT
  ☆223Updated 2 years ago
• deepset-ai / prompthub
  ☆183Updated last year
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated 10 months ago
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆84Updated last year
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆263Updated last year
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆255Updated last year
• run-llama / ai-engineer-workshop
  ☆186Updated 2 years ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆334Updated last year
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆340Updated last year
• meistrari / cursive-py
  ✦ The intuitive python LLM framework
  ☆176Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆293Updated 6 months ago
• BerriAI / bettertest
  ☆74Updated last year
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆320Updated 5 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆188Updated last year
• lamini-ai / lamini-examples
  ☆164Updated 10 months ago
• felixbrock / lemon-agent
  Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation
  ☆348Updated 2 years ago
• langchain-ai / kork
  Natural Language Interfaces Powered by LLMs
  ☆96Updated last year
• tg1482 / priomptipy
  A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.
  ☆113Updated 5 months ago
• epfl-dlab / aiflows
  🤖🌊 aiFlows: The building blocks of your collaborative AI
  ☆273Updated last year
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆238Updated 2 years ago
• seanchatmangpt / dspygen
  A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
  ☆132Updated last year
• ssheng / BentoChain
  A voice-enabled chatbot application built using of 🦜️🔗 LangChain, text-to-speech, and speech-to-text models from 🤗 Hugging Face, and …
  ☆195Updated 2 years ago
• VectorBoard / vectorboard
  Open Source Embeddings Optimisation and Eval Framework for RAG/LLM Applications. Documentations at https://docs.vectorboard.ai/introducti…
  ☆50Updated 2 years ago
• amosjyng / vcr-langchain
  Record and replay LLM interactions for langchain
  ☆82Updated last year
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆264Updated last week
• shroominic / fastui-chat
  💬 minimalistic ChatBot Interface in pure python
  ☆226Updated last year
• weaviate / healthsearch-demo
  Discover Healthsearch: Unlocking Health with Semantic Search ✨
  ☆178Updated 2 years ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 4 months ago