Alternatives and similar repositories for openinference

Users that are interested in openinference are comparing it to the libraries listed below

• langchain-ai / agent-protocol
  ☆344Updated 2 weeks ago
• langfuse / langfuse-python
  🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …
  ☆172Updated this week
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆590Updated last month
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆419Updated last year
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆298Updated 5 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆278Updated 2 weeks ago
• deepset-ai / hayhooks
  Easily deploy Haystack pipelines as REST APIs and MCP Tools.
  ☆81Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆243Updated 2 months ago
• langchain-ai / agentevals
  Readymade evaluators for agent trajectories
  ☆190Updated last week
• langchain-ai / langsmith-sdk
  LangSmith Client SDK Implementations
  ☆547Updated this week
• langchain-ai / openevals
  Readymade evaluators for your LLM apps
  ☆371Updated this week
• Unstructured-IO / unstructured-python-client
  A Python client for the Unstructured Platform API
  ☆101Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆202Updated 9 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆246Updated 6 months ago
• deepset-ai / haystack-core-integrations
  Additional packages (components, document stores and the likes) to extend the capabilities of Haystack
  ☆150Updated this week
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆238Updated 7 months ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆123Updated 3 weeks ago
• Arize-ai / client_python
  A python library to send data to Arize AI!
  ☆53Updated last week
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆313Updated 2 months ago
• brandonstarxel / chunking_evaluation
  This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…
  ☆305Updated last month
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆230Updated last month
• Scale3-Labs / langtrace
  Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…
  ☆924Updated last week
• hinthornw / trustcall
  Tenacious tool calling built on LangGraph
  ☆695Updated 3 weeks ago
• Arize-ai / open-inference-spec
  A specification for OpenInference, a semantic mapping of ML inferences
  ☆46Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆153Updated 7 months ago
• run-llama / multi-agent-concierge
  An example of multi-agent orchestration with llama-index
  ☆421Updated 3 months ago
• superlinked / VectorHub
  VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector re…
  ☆471Updated this week
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆261Updated 10 months ago
• 567-labs / systematically-improving-rag
  ☆120Updated last week
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆116Updated this week