Alternatives and similar repositories for benchllm:

Users that are interested in benchllm are comparing it to the libraries listed below

• edreisMD / plugnplai
  🎸 Integrating AI plugins to LLMs
  ☆230Updated last year
• deepset-ai / prompthub
  ☆154Updated last year
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆174Updated 10 months ago
• 567-labs / systematically-improving-rag
  ☆80Updated 2 weeks ago
• jxnl / n-levels-of-rag
  ☆195Updated 8 months ago
• yeagerai / genworlds
  A framework for event based autonomous multi-agent systems.
  ☆299Updated 4 months ago
• BerriAI / bettertest
  ☆75Updated last year
• timho102003 / NewsGPT
  ☆219Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆258Updated this week
• felixbrock / lemon-agent
  Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation
  ☆326Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆400Updated 8 months ago
• run-llama / ai-engineer-workshop
  ☆184Updated last year
• krrishdholakia / betterprompt
  Test suite for LLM prompts
  ☆46Updated 8 months ago
• robocorp / llmstatemachine
  A Python library for building GPT-powered agents with state machine logic and chat history memory.
  ☆64Updated last year
• ritun16 / chain-of-verification
  This repository implements the chain of verification paper by Meta AI
  ☆160Updated last year
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆79Updated last year
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆96Updated last week
• llamaapi / llamaapi-python
  ☆91Updated last year
• mme / langforge
  A Toolkit for Creating and Deploying LangChain Apps
  ☆168Updated last year
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆262Updated 10 months ago
• shroominic / funcchain
  ⛓️ build cognitive systems, pythonic
  ☆329Updated 2 months ago
• shaman-ai / agent-actors
  ☆270Updated last year
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆329Updated 5 months ago
• krohling / bondai
  ☆197Updated last year
• seanchatmangpt / dspygen
  A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
  ☆117Updated 3 months ago
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆90Updated 11 months ago
• villagecomputing / superopenai
  Logging and caching superpowers for the openai sdk
  ☆102Updated 10 months ago
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆48Updated 4 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆239Updated 3 months ago
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆145Updated 9 months ago