AI-driven toolkit that automates evaluation processes for AI agents
☆38Mar 10, 2026Updated 6 months ago
Alternatives and similar repositories for Agent-EvalKit
Users that are interested in Agent-EvalKit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A comprehensive evaluation framework for AI agents and LLM applications.☆201Updated this week
- Toolkit for Seamlessly Enabling RL Training on Any Agent with Bedrock AgentCore.☆60Updated this week
- Your trusted generative AI knowledge hub☆16Updated this week
- ☆37Sep 2, 2026Updated 2 weeks ago
- Sample voice agent application based on Amazon Nova 2 Sonic and Amazon Kinesis Video Streams WebRTC service. It demonstrates the real-tim…☆20May 16, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆25Feb 11, 2026Updated 7 months ago
- Deep research agent using Amazon Bedrock, AgentCore, and LangGraph☆28Jun 30, 2026Updated 2 months ago
- A full-stack AI chat application powered by Amazon Bedrock and Strands Agents☆51Feb 14, 2026Updated 7 months ago
- Get up and running quickly with an AI agent application on AWS using Bedrock AgentCore☆29Nov 3, 2025Updated 10 months ago
- A workflow that hits a weather API and updates a website to show current conditions☆16Apr 2, 2026Updated 5 months ago
- Real-time voice AI agent with Amazon Nova Sonic and AWS Bedrock AgentCore. Features bidirectional streaming, React UI, WebSocket communic…☆19Apr 23, 2026Updated 4 months ago
- Multi-Tenant remote MCP server with Amazon Cognito and remote client with Amazon Bedrock hosted on AWS☆19Updated this week
- ☆17Jun 2, 2026Updated 3 months ago
- A real-time conversational AI platform built on AWS with Amazon Bedrock Nova Sonic for voice and Amazon Bedrock AgentCore Runtime for cha…☆18Jul 10, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Quickly build a document processing agent with AWS Bedrock agents☆14Mar 17, 2025Updated last year
- I'll guide you through setting up the resources, defining the agent's action groups, associating AWS Lambda functions to execute DynamoDB…☆12Apr 13, 2026Updated 5 months ago
- ☆39Aug 26, 2026Updated 3 weeks ago
- 旨在帮助杭州电子科技大学硕博生使用 Latex完成学位论文撰写，非官方模板，如若使用，后果自负！☆21Jan 8, 2025Updated last year
- Tutorial Materials for the paper "Evaluation & Benchmarking of LLM Agents: A Survey" published in KDD 2025 Conference.☆21Jun 12, 2026Updated 3 months ago
- CDK template that deploys real-time voice interaction app using Amazon Nova Sonic with tool use☆66Jun 10, 2026Updated 3 months ago
- MEME: Multi-Entity & Evolving Memory Evaluation — reference implementation (companion to arXiv preprint)☆25May 11, 2026Updated 4 months ago
- Python CLI toolkit for Amazon Bedrock AgentCore (legacy). For new projects, use the AgentCore CLI: https://github.com/aws/agentcore-cli☆509Updated this week
- Amazon Nova Act is an AWS service for building and deploying highly reliable AI agents that automate UI-based workflows at scale.☆66Aug 18, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆15Jul 4, 2025Updated last year
- Deep learning for pedestrians: backpropagation in CNNs. Latex and PyTorch code to verify theoretical derivations.☆13Jun 21, 2022Updated 4 years ago
- LLM eval skills for developers. Free tools to find failure patterns, build evals, and improve AI quality in production☆22Apr 24, 2026Updated 4 months ago
- MCP Registry Demo - A reference implementation on Azure API Center☆13May 17, 2025Updated last year
- A generative AI-powered framework for testing virtual agents.☆373Dec 15, 2025Updated 9 months ago
- ☆29Oct 13, 2021Updated 4 years ago
- ☆19Apr 21, 2021Updated 5 years ago
- Skill to annotate and create ai judges from agent logs☆17Oct 28, 2025Updated 10 months ago
- ☆18Oct 5, 2025Updated 11 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- AWS Agent Core Icons ( Unofficial ) Agent Core Identity, Agent Core Runtime, Agent Core Memory, Agent Core Observability☆31Oct 18, 2025Updated 11 months ago
- ☆24Apr 30, 2026Updated 4 months ago
- Nancy components for building Hydra hypermedia API☆18Dec 6, 2019Updated 6 years ago
- Example project showing how you can use your fast.ai based scripts to let Amazon SageMaker perform the training and hosting of your model…☆14Feb 20, 2019Updated 7 years ago
- How to build a simplified Corrective RAG assistant with Amazon Bedrock using LLMs, Embeddings model, Knowledge Bases for Amazon Bedrock, …☆16May 22, 2024Updated 2 years ago
- The core and community plugins for Perses☆31Updated this week
- Production eval framework for Claude Agent SDK — implements Anthropic's published eval patterns with native SDK hooks, a 50-case golden d…☆22Jun 1, 2026Updated 3 months ago