Leniolabs / promptwizard
Prompt Wizard is a package for evaluating custom prompts using various evaluation methods. It allows you to provide your own prompts or generate them automatically and then obtain the results in a JSON file. You can also use the library for your Python projects.
☆12Updated last year
Alternatives and similar repositories for promptwizard:
Users that are interested in promptwizard are comparing it to the libraries listed below
- AI conflict resolution framework designed to work alongside existing AI orchestration tools☆24Updated 4 months ago
- Discover advanced AI techniques in my repository combining Multi-Hop Chain of Thought (CoT) and Retrieval-Augmented Generation (RAG) usin…☆13Updated 8 months ago
- ☆41Updated 4 months ago
- An AI agent that writes code for you☆11Updated 10 months ago
- A simple to use package to call various model providers such as openai, anthropic, and others with utmost reliability, security, and perf…☆12Updated 3 weeks ago
- A framework for high-fidelity retrieval augmented generation in industrial knowledge bases. Integrates jargon identification, context rec…☆30Updated 8 months ago
- A powerful MCP (Model Context Protocol) Server that audits npm package dependencies for security vulnerabilities. Built with remote npm r…☆24Updated this week
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆26Updated 3 weeks ago
- This is an opensource project allowing you to compare two LLM's head to head with a given prompt, it has a wide range of supported models…☆22Updated last month
- Unstract's interface to LLMs, Embeddings and VectorDBs.☆18Updated 9 months ago
- A production-grade multi-agent system for comprehensive medical diagnosis and coding using specialized AI agents.☆37Updated 2 weeks ago
- RAGLight is a lightweight and modular Python library for implementing Retrieval-Augmented Generation (RAG), Agentic RAG and RAT (Retrieva…☆24Updated last month
- Deepseek R1 Agent powered by LMStudio and Smolagents☆30Updated 3 months ago
- InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …☆112Updated 11 months ago
- ☆13Updated 2 weeks ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆44Updated last week
- MCP Server for Bing Search API☆31Updated 3 weeks ago
- A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!☆32Updated this week
- Curated resources about automated GUI computer-use via LLMs. Highly opinionated, focus is on quality vs quantity.☆22Updated 5 months ago
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆25Updated last week
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆34Updated last year
- Luann allows you to create a LLM agent,which has complete memory module (long-term memory, short-term memory) and knowledge module（Variou…☆21Updated last month
- Professional Wargaming LLM Toolbox☆11Updated 6 months ago
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆30Updated 3 weeks ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 5 months ago
- Open Agent Computer Interface☆64Updated 5 months ago
- MCP server for querying the Shodan API☆32Updated last month
- AG2 (formerly AutoGen) is a programming framework for agentic AI. Join the community at: https://discord.gg/pAbnFJrkgZ☆13Updated 3 months ago
- ElasticSearch agent based on ElasticSearch, LangChain and ChatGPT 4☆46Updated last year
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆22Updated 7 months ago