preset-io / promptimize
Promptimize is a prompt engineering evaluation and testing toolkit.
β454Updated 2 weeks ago
Alternatives and similar repositories for promptimize:
Users that are interested in promptimize are comparing it to the libraries listed below
- β496Updated 7 months ago
- π° PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.β572Updated this week
- LLMFlows - Simple, Explicit and Transparent LLM Appsβ692Updated last month
- syntactic sugar π for langchainβ232Updated 6 months ago
- Build robust LLM applications with true composability πβ416Updated last year
- β766Updated last year
- A tool for evaluating LLMsβ413Updated 11 months ago
- βοΈ build cognitive systems, pythonicβ333Updated 4 months ago
- β161Updated last year
- Python SDK for running evaluations on LLM generated responsesβ276Updated last week
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errorsβ651Updated last year
- Make sense of it all. Semantic data modeling and analytics with a sprinkle of AI. https://totalhack.github.io/zillion/β197Updated last year
- Ξ»prompt - A functional programming interface for building AI systemsβ379Updated last year
- Edge full-stack LLM platform. Written in Rustβ378Updated 10 months ago
- π§ Motorhead is a memory and information retrieval server for LLMs.β873Updated last week
- β879Updated 4 months ago
- Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Typesβ395Updated last month
- π¦π― Flex those feathers!β244Updated 5 months ago
- An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomerβ224Updated 3 weeks ago
- β184Updated last year
- π LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). π Extracts signals from prompts & responses, ensuring saβ¦β898Updated 4 months ago
- Natural Language Interfaces Powered by LLMsβ90Updated 8 months ago
- LLM(π½)β1,666Updated 2 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroβ¦β2,829Updated 8 months ago
- β299Updated 5 months ago
- LLM fine-tuning and evalβ346Updated last year
- LangSmith Client SDK Implementationsβ521Updated this week
- Superagent Python SDKβ134Updated 10 months ago
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of yβ¦β691Updated 10 months ago
- Data-Driven Evaluation for LLM-Powered Applicationsβ488Updated 2 months ago