Helicone / helicone
🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23
☆1,947Updated this week
Related projects ⓘ
Alternatives and complementary repositories for helicone
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,081Updated this week
- Zep | The Memory Foundation For Your AI Stack☆2,710Updated last month
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.☆1,460Updated last month
- The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stanford DSP paper.☆1,150Updated this week
- Stealth browsers as a service. Connect your scraper or automation to a fleet of cloud-hosted browsers configured for reliability and stea…☆2,302Updated last month
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆856Updated this week
- Turn expensive prompts into cheap fine-tuned models☆2,500Updated 5 months ago
- Open-source toolkit to build an AI copilot for SaaS products☆579Updated 3 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,713Updated 3 months ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆836Updated 10 months ago
- Vision utilities for web interaction agents 👀☆1,450Updated this week
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆632Updated last year
- The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.☆1,282Updated this week
- Adding guardrails to large language models.☆4,127Updated this week
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,265Updated this week
- 🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and mo…☆921Updated this week
- Data framework for your LLM applications. Focus on server side solution☆1,951Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆6,598Updated this week
- An open-source visual programming environment for battle-testing prompts to LLMs.☆2,346Updated 3 weeks ago
- Amplify your team's potential with customizable and secure AI assistants.☆974Updated this week
- Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building age…☆997Updated 5 months ago
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,017Updated this week
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆521Updated this week
- Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliabi…☆428Updated 7 months ago
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆974Updated last week
- All-in-one infrastructure for search, recommendations, RAG, and analytics offered via API☆1,591Updated this week
- No-code multi-agent framework to build LLM Agents, workflows and applications with your data☆1,611Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI…☆2,111Updated this week
- The TypeScript framework for AI development☆1,108Updated 8 months ago
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆4,784Updated this week