comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
☆6,100Updated this week
Alternatives and similar repositories for opik:
Users that are interested in opik are comparing it to the libraries listed below
- Agent Framework / shim to use Pydantic with LLMs☆8,016Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,987Updated last month
- Flexible and powerful framework for managing multiple AI agents and handling complex conversations☆4,593Updated last week
- Composable building blocks to build Llama Apps☆7,597Updated this week
- Build resilient language agents as graphs.☆10,961Updated this week
- A lightweight library for building Multimodal Agents. Use it to give LLMs superpowers like memory, knowledge, tools and reasoning.☆23,266Updated this week
- In-depth tutorials on LLMs, RAGs and real-world AI agent applications.☆7,114Updated last week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including O…☆4,160Updated this week
- A visual playground for agentic workflows: Iterate over your agents 10x faster☆4,160Updated this week
- SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆6,060Updated this week
- A language model programming library.☆5,723Updated last month
- This repository provides tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a…☆11,101Updated last week
- Everything you need to know to build your own RAG application☆2,758Updated last week
- The easiest way to use Agentic RAG in any enterprise☆4,177Updated 2 months ago
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆3,532Updated this week
- AdalFlow: The library to build & auto-optimize LLM applications.☆2,907Updated last week
- Task-Aware Agent-driven Prompt Optimization Framework☆3,073Updated 2 weeks ago
- File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.☆5,929Updated last month
- PraisonAI is a production-ready Multi AI Agents framework, designed to create AI Agents to automate and solve problems ranging from simpl…☆3,687Updated this week
- 🪄 Create rich visualizations with AI☆11,106Updated last week
- Full toolkit for running an AI agent service built with LangGraph, FastAPI and Streamlit☆2,579Updated last week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆10,077Updated this week
- The fast, Pythonic way to build Model Context Protocol servers 🚀☆3,557Updated last week
- Building AI agents, atomically☆3,252Updated last week
- NVIDIA Ingest is an early access set of microservices for parsing hundreds of thousands of complex, messy unstructured PDFs and other ent…☆2,631Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆3,085Updated last week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,983Updated last week
- Knowledge Agents and Management in the Cloud☆3,853Updated this week
- Desktop app for prototyping and debugging LangGraph applications locally.☆2,704Updated 3 weeks ago
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆20,152Updated this week