arthur-ai / bench

Related projects ⓘ

Alternatives and complementary repositories for bench

• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆260Updated this week
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆385Updated 9 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆234Updated 3 weeks ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆311Updated last week
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆221Updated this week
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆218Updated this week
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆559Updated 6 months ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆327Updated 3 months ago
• deepset-ai / prompthub
  ☆144Updated 10 months ago
• run-llama / ai-engineer-workshop
  ☆179Updated last year
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆390Updated 11 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆484Updated 2 weeks ago
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆146Updated 7 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆171Updated 8 months ago
• langchain-ai / langsmith-sdk
  LangSmith Client SDK Implementations
  ☆419Updated this week
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆262Updated 8 months ago
• langchain-ai / auto-evaluator
  ☆744Updated 10 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆163Updated 4 months ago
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆469Updated last year
• rogeriochaves / langstream
  Build robust LLM applications with true composability 🔗
  ☆416Updated 10 months ago
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆521Updated this week
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆222Updated last month
• philschmid / easyllm
  ☆433Updated 10 months ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆488Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆114Updated this week
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆226Updated 2 months ago
• PAIR-code / llm-comparator
  LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…
  ☆322Updated last month
• anthropics / anthropic-tools
  ☆267Updated 2 weeks ago
• ray-project / llmperf-leaderboard
  ☆430Updated 10 months ago