Helicone / helicone
๐ง Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. ๐ YC W23
โ1,703Updated this week
Related projects: โ
- The production toolkit for LLMs. Observability, prompt management and evaluations.โ1,020Updated this week
- Zep: Long-Term Memory for โAI Assistants.โ2,363Updated last week
- An open-source visual programming environment for battle-testing prompts to LLMs.โ2,208Updated last month
- Turn expensive prompts into cheap fine-tuned modelsโ2,472Updated 3 months ago
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.โ1,925Updated this week
- Data integration platform that makes it easy and fast to build custom integrations in python.โ1,682Updated this week
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroโฆโ2,627Updated last month
- The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stanford DSP paper.โ1,020Updated this week
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errorsโ628Updated 9 months ago
- AutoChain: Build lightweight, extensible, and testable LLM Agentsโ1,778Updated 3 months ago
- LlamaIndex in TypeScriptโ1,771Updated this week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Geโฆโ4,170Updated this week
- ๐ชข Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llamโฆโ5,596Updated this week
- LLM(๐ฝ)โ1,602Updated this week
- Adding guardrails to large language models.โ3,873Updated this week
- Open-source observability for your LLM application, based on OpenTelemetryโ1,836Updated this week
- The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.โ1,296Updated last month
- No-code multi-agent framework to build LLM Agents, workflows and applications with your dataโ1,446Updated this week
- ๐ง Motorhead is a memory and information retrieval server for LLMs.โ846Updated last month
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pineconeโ948Updated 3 weeks ago
- Vision utilities for web interaction agents ๐โ1,373Updated this week
- ๐ค Deploy a private ChatGPT alternative hosted within your VPC. ๐ฎ Connect it to your organization's knowledge base and use it as a corpoโฆโ1,457Updated last year
- The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.โ1,167Updated this week
- The web framework for building LLM microservicesโ971Updated 2 months ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastrโฆโ1,123Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.โ1,890Updated last week
- Prompt design using JSX.โ1,027Updated 3 months ago
- Amplify your team's potential with customizable and secure AI assistants.โ932Updated this week
- Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building ageโฆโ942Updated 3 months ago
- โ1,386Updated 10 months ago