preset-io / promptimize
Promptimize is a prompt engineering evaluation and testing toolkit.
β445Updated this week
Alternatives and similar repositories for promptimize:
Users that are interested in promptimize are comparing it to the libraries listed below
- π¦π― Flex those feathers!β239Updated 4 months ago
- π° PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.β557Updated this week
- β157Updated last year
- Build robust LLM applications with true composability πβ415Updated last year
- LLMFlows - Simple, Explicit and Transparent LLM Appsβ683Updated 3 weeks ago
- β756Updated last year
- OpenTelemetry Instrumentation for AI Observabilityβ300Updated this week
- π LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). π Extracts signals from prompts & responses, ensuring saβ¦β879Updated 2 months ago
- Ξ»prompt - A functional programming interface for building AI systemsβ377Updated last year
- βοΈ build cognitive systems, pythonicβ331Updated 3 months ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.β283Updated 3 months ago
- An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomerβ213Updated 2 months ago
- β286Updated 3 months ago
- Python SDK for running evaluations on LLM generated responsesβ266Updated this week
- syntactic sugar π for langchainβ232Updated 4 months ago
- Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Typesβ393Updated last month
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errorsβ641Updated last year
- Visualization and debugging tool for LangChain workflowsβ730Updated 11 months ago
- A simple Python sandbox for helpful LLM data agentsβ222Updated 8 months ago
- A tool for evaluating LLMsβ402Updated 9 months ago
- Tools for using Langchain with Prefectβ103Updated last year
- Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automationβ327Updated last year
- β841Updated 2 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!β79Updated last year
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pineconeβ1,005Updated 3 months ago
- LangSmith Client SDK Implementationsβ482Updated this week
- Create repos and commits with AI.β294Updated last year
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicatiβ¦β236Updated 4 months ago
- Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building ageβ¦β1,098Updated last month
- β113Updated 8 months ago