promptfoo / promptfoo-actionLinks
The GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
☆28Updated last week
Alternatives and similar repositories for promptfoo-action
Users that are interested in promptfoo-action are comparing it to the libraries listed below
Sorting:
- ☆120Updated last month
- Agile Agents (A2) is an open-source framework for the creation and deployment of serverless intelligent agents using public and private c…☆30Updated last year
- A powerful and simple asynchronous task management system that divides complex tasks into subtasks, processes them concurrently using o1 …☆16Updated 11 months ago
- For LLMs to better code with Jina API☆173Updated 3 months ago
- This implementation follows the official MCP specification, including proper message framing, transport layer implementation, and complet…☆55Updated last year
- converts url content into JSON with a simple prefix☆71Updated last year
- An assistant for Slack built with Arcade and Langgraph. Interact with Google Calendar, Mail, Github, Search Engines, Firecrawl and more a…☆114Updated 6 months ago
- A specification language for AI-first development that shifts focus from implementation to intent through structured solution space reduc…☆105Updated last month
- ☆171Updated last year
- ☆47Updated last year
- Build robust, production grade function calling assistants that work. Declarative and extensible. Built on top of LangChain ⚡️☆76Updated last year
- a simple example demonstrating MCP + ag2 (autogen) integration☆41Updated 4 months ago
- A framework for hosting and scaling AI agents.☆38Updated last year
- 🤖 Headless IDE for AI agents☆200Updated 2 months ago
- Anthropic Computer Use with Modal Sandboxes☆42Updated last year
- Policy Synth is a TypeScript class library designed to streamline and enhance decision-making processes through multi-scale AI agent logi…☆54Updated last week
- dspy-cli is a tool for creating, developing, testing, and deploying DSPy programs as HTTP APIs.☆55Updated last week
- Groq Compound Beta MCP Server☆42Updated last week
- ☆113Updated 5 months ago
- Writing and Citation Assistant Tool☆35Updated this week
- Model Context Protocol (MCP) Server for Langfuse Prompt Management. This server allows you to access and manage your Langfuse prompts thr…☆148Updated 9 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆72Updated last month
- Contains the prompts we use to talk to various LLMs for different utilities inside the editor☆83Updated last year
- Not Diamond Python SDK☆89Updated 3 weeks ago
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated 2 years ago
- ☆107Updated last month
- Proposal for a flexible, tool-agnostic, codebase context system that helps teach AI coding tools about your codebase. Super easy to get …☆136Updated 8 months ago
- A toolkit for building computer use AI agents☆180Updated 5 months ago
- Examples and guides for using the Steel API☆66Updated last week
- Structured outputs from DSPy and Jinja2☆26Updated 5 months ago