athina-ai / athina-evals

Related projects ⓘ

Alternatives and complementary repositories for athina-evals

• zenbase-ai / core
  Prompt engineering, automated.
  ☆246Updated 2 weeks ago
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆447Updated 2 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆234Updated 3 weeks ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆218Updated this week
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆341Updated 6 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆222Updated last month
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆392Updated 6 months ago
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆444Updated 6 months ago
• phospho-app / phospho
  Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …
  ☆377Updated this week
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆226Updated 2 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆97Updated 11 months ago
• jxnl / n-levels-of-rag
  ☆182Updated 6 months ago
• mendableai / rag-arena
  Open-source RAG evaluation through users' feedback
  ☆161Updated 7 months ago
• braintrustdata / autoevals
  AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
  ☆248Updated this week
• langwatch / langwatch
  Source available LLM Ops platform and LLM Optimization Studio powered by DSPy.
  ☆341Updated this week
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆170Updated 5 months ago
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆390Updated this week
• lion-agi / lionagi
  An AGentic Intelligence Operating System
  ☆296Updated last week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆163Updated 4 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆74Updated 2 months ago
• redotvideo / haven
  LLM fine-tuning and eval
  ☆341Updated 8 months ago
• diicellman / dspy-rag-fastapi
  FastAPI wrapper around DSPy
  ☆214Updated 8 months ago
• plastic-labs / honcho
  self-improving user memory framework for conversational AI apps
  ☆145Updated this week
• eidolon-ai / eidolon
  The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications
  ☆286Updated this week
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆390Updated 11 months ago
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆219Updated this week
• seanchatmangpt / dspygen
  A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
  ☆110Updated last month
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆262Updated 8 months ago
• Scale3-Labs / langtrace
  Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…
  ☆583Updated this week
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆289Updated 6 months ago