Universal Agent Evaluation Framework (UAEF) is a framework-agnostic evaluation system for AI agents. Invoke any agent and score it on multiple metrics spanning tool calling, response quality, safety, performance, and reasoning. Track experiments against baselines, catch regressions automatically, and get LLM-generated insights.
☆156Nov 13, 2026Updated this week
Alternatives and similar repositories for uaef
Users that are interested in uaef are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Turn a product into an agentic RL environment☆38Updated this week
- jev + fs = findme☆26Sep 19, 2026Updated last month
- Durable workflow execution for the JVM☆45Updated this week
- Using LangGraph Builder and Studio to build amazing Agentic Systems☆11May 20, 2025Updated last year
- Spiking around on RemoteGraph functionality in LangGraph☆12Apr 24, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- In tree calculus, typing becomes programming. The paper is supported by proofs in Rocq☆19Nov 4, 2026Updated last week
- Pluggable Agentic AI Framework is a hands-on workshop that builds a multi-agent customer support system on AWS using Amazon Bedrock Agent…☆17Jul 28, 2026Updated 3 months ago
- ☆43Jun 9, 2026Updated 5 months ago
- An open-source, ontology-based semantic context accelerator that enables AI agents to make more accurate, consistent, and explainable dec…☆1,178Updated this week
- An open protocol and client for what your coding agents are doing: hooks for every harness, four privacy tiers, any sink.☆24Updated this week
- A native app that puts GitHub, a code browser, and Claude/Codex in one window.☆18Updated this week
- scikit-learn-compatible classical machine learning accelerated with MLX on Apple silicon☆47Updated this week
- Gen AI Evaluation Toolkit on AWS is a flexible, cloud-native accelerator built on AWS serverless architecture that enables comprehensive …☆21Oct 30, 2026Updated 2 weeks ago
- ☆18Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Higher Order Harness (HOH "/oʊ/" ), projected as a unified chat interface.☆102Oct 26, 2026Updated 3 weeks ago
- Keep your sensitive credentials out of the agents you build and the coding agent you use. Test any agent with planted fake keys, or see w…☆19Updated this week
- Run Escha models on Apple Silicon: 2-bit escha runtime for MLX with bit-exact Metal kernels and OpenAI-compatible serving.☆19Sep 16, 2026Updated 2 months ago
- AI agents library for Rust, aiming to be minimal but extensible☆17Aug 15, 2026Updated 3 months ago
- ☆58Updated this week
- RE Rust rewrites on steroids☆48Updated this week
- A small, fast decision model, or system one model, for agentic workflows. Pick between options or rate on a scale faster than an LLM, wit…☆1,216Updated this week
- GitHub Actions workflows in any language☆24Nov 11, 2026Updated last week
- Get token optimized terraform plans representation☆22May 17, 2026Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Amazon Q Business Token Vending machine and Custom AI Assistant UI (QUI)☆11Oct 27, 2026Updated 3 weeks ago
- Sandbox first AI coding harness☆55Updated this week
- A CLI that extracts the useful structure from source files: signatures, imports, types, variables, comments, and Markdown sections.☆44Jul 15, 2026Updated 4 months ago
- One-command deployment of open-source world models on AWS. Each model is a self-contained cartridge served behind a uniform API on EC2 or…☆14Updated this week
- Fluent is a self-improving software factory. It autonomously turns your team's vision, ideas, bug reports, user feedback, production logs…☆133Nov 11, 2026Updated last week
- ☆10Jul 11, 2024Updated 2 years ago
- .feels() on anything — the AI if statement as a real, typed method. Jev + BAML.☆24Sep 19, 2026Updated last month
- Lightweight AI forward engineering standards for software development☆14Updated this week
- Relax Rust JIT☆589Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- cleans build files☆18Jul 29, 2026Updated 3 months ago
- MoJev: typed, calibrated decisions in one forward pass.☆30Sep 23, 2026Updated last month
- Pi extension: colored status pills with icons, labeled headings and colored bold, so assistant replies are easy to scan☆27Updated this week
- ☆33Updated this week
- Replay your coding agent sessions as a map and a timeline☆370Updated this week
- AI-DLC 2026 Methodology - Iterative AI-driven development with hat-based workflows☆18Nov 5, 2026Updated last week
- Weixin iLink bot adapter for Chat SDK.☆14Jul 20, 2026Updated 3 months ago
Are these results useful?