madviking / pydantic-llm-testerLinks
This will test with mock data the accuracy of LLM response. Uses Pydantic models and PydanticAI.
☆18Updated 3 months ago
Alternatives and similar repositories for pydantic-llm-tester
Users that are interested in pydantic-llm-tester are comparing it to the libraries listed below
Sorting:
- WebRAgent is a retrieval-augmented generation (RAG) web application featuring agent-based query decomposition, vector search with Qdrant,…☆49Updated 5 months ago
- awesome-rag: a collection of awesome thing related to Retrieval-Augmented Generation☆128Updated last month
- Long-Term Memory & Context Management for LLMs☆66Updated 2 weeks ago
- Open-Source RAG app with LLM Observability (Langfuse), support for 100+ providers (LiteLLM), Dockerized, Full Type-checking, 100% Test co…☆159Updated 6 months ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆220Updated this week
- Use smol agents to do research and then update csv coumns with its findings.☆41Updated 7 months ago
- Retrieval-augmented generation (RAG) for remote & local LLM use☆45Updated 3 months ago
- An Automated AI-Powered Prompt Optimization Framework☆199Updated last year
- Structured AI Prompt Engineering Agent based on OpenAI’s best practices☆32Updated 4 months ago
- Convert your idea to a plan☆240Updated this week
- A multi-agent AI research system designed to know what it knows (and doesn't know) when conducting research and creating content.☆170Updated 6 months ago
- Declarative framework to build LLM-based applications☆127Updated 9 months ago
- An advanced retrieval system that combines semantic vector search with token-based search, using contextual chunking and knowledge graphs…☆40Updated 11 months ago
- AI agents platform that gives you a workspace with an integrated team of personal assistants that can work behind the scenes to handle da…☆180Updated last month
- Open-source AI-powered data science platform.☆192Updated this week
- The AI runtime that turns your framework functions into OpenAI compatible endpoints☆83Updated 6 months ago
- Find your files with natural language and ask questions.☆51Updated 2 weeks ago
- Simple, Opinionated benchmark for testing the viability of Efficient Language Models (ELMs) for personal use cases.☆48Updated last year
- ☆38Updated last year
- This is a lightweight script designed to index the structure of a project by identifying the locations of classes, functions, and files. …☆55Updated 4 months ago
- SynthLang is a hyper-efficient prompt language designed to optimize interactions with Large Language Models (LLMs) like GPT-4o by leverag…☆219Updated 5 months ago
- ManusMCP is a project that implements AI agent workflows using Flowise. It features specialized AI agents with distinct roles (Planner, F…☆83Updated 4 months ago
- PydanticAI helper which includes cost tracking. Also serves as a test benchmark for LLM dev tools in context of a slightly bigger project…☆35Updated 3 months ago
- Call another MCP client from your MCP client. Offload context windows, delegate tasks, split between models☆28Updated 6 months ago
- Generates breakthrough ideas from a single prompt through an 8 stage walkthrough, with optional research proposal paper.☆55Updated 6 months ago
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆160Updated 7 months ago
- FastAPI template made for AI☆41Updated 6 months ago
- A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your…☆105Updated 9 months ago
- MCP server for enabling LLM applications to perform deep research via the MCP protocol☆235Updated 2 months ago
- Linkedin Ghostwriting agent powered by Langgraph☆107Updated 5 months ago