Alternatives and similar repositories for openllmtelemetry

Users that are interested in openllmtelemetry are comparing it to the libraries listed below

• whylabs / whylabs-toolkit
  A python package to make it easier to interact with WhyLabs APIs
  ☆13Updated 5 months ago
• whylabs / whylabs-oss
  Source code of the WhyLabs Platform OSS
  ☆12Updated 4 months ago
• robbyt / llm_proxy
  AI aware proxy
  ☆18Updated 8 months ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆446Updated this week
• saharmor / voice-lab
  Testing and evaluation framework for voice agents
  ☆121Updated this week
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆281Updated 2 weeks ago
• hwchase17 / langfuzz
  ☆72Updated 7 months ago
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆913Updated 6 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆77Updated 3 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆181Updated last year
• whyhow-ai / whyhow
  Automated knowledge graph creation SDK
  ☆122Updated 6 months ago
• mendableai / rag-arena
  Open-source RAG evaluation through users' feedback
  ☆185Updated last year
• deadbits / vector-embedding-api
  Flask API for generating text embeddings using OpenAI or sentence_transformers
  ☆14Updated last year
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆172Updated 8 months ago
• langchain-ai / langgraph-gen-py
  CLI to generate LangGraph stubs from a specification
  ☆74Updated 2 months ago
• andrestorres123 / delve
  ☆44Updated 3 months ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆57Updated last week
• Portkey-AI / portkey-python-sdk
  Build reliable, secure, and production-ready AI apps easily.
  ☆73Updated last week
• invariantlabs-ai / invariant-gateway
  LLM proxy to observe and debug what your AI agents are doing.
  ☆33Updated this week
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆301Updated 2 weeks ago
• langchain-ai / agentevals
  Readymade evaluators for agent trajectories
  ☆230Updated 2 weeks ago
• Barneyjm / langchain-autotools
  Generate Tools and Toolkits from any Python SDK -- no extra code required
  ☆50Updated 7 months ago
• deepset-ai / haystack-experimental
  🧪 Experimental features for Haystack
  ☆45Updated this week
• Arize-ai / phoenix-on-azure
  ☆23Updated 8 months ago
• run-llama / mcp-server-llamacloud
  A MCP server connecting to managed indexes on LlamaCloud
  ☆76Updated last month
• lz-chen / research-agent
  ☆86Updated 3 weeks ago
• Giskard-AI / giskard-vision
  📸 Open-Source Evaluation & Testing for Computer Vision AI systems
  ☆28Updated 7 months ago
• vbarda / encite
  Named Entity Recognition using Claude Citations
  ☆74Updated 2 months ago
• aiverify-foundation / aiverify
  AI Verify
  ☆13Updated this week
• SylphAI-Inc / GithubChat
  A practical RAG where you can download and chat with github repo
  ☆80Updated 3 months ago