Evaluation package that allows benchmarking of agentic AIs from various sources and frameworks by producing statistical results which can be compared across different use cases and datasets.
☆78Jun 26, 2026Updated 4 months ago
Alternatives and similar repositories for agent-quality-inspect
Users that are interested in agent-quality-inspect are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A parallel evaluation data set of SAP software documentation with document structure annotation☆15Jun 12, 2026Updated 4 months ago
- Source code for the paper "Attention Is (not) All You Need for Commonsense Reasoning" published at ACL 2019.☆14Aug 2, 2024Updated 2 years ago
- A client SDK for the Data Attribute Recommendation service on SAP Business Technology Platform (SAP BTP). Part of SAP AI Business Service…☆21Jun 30, 2026Updated 4 months ago
- AI swarm framework. Spawn agents, connect them however you want, let them talk. That's it. Pure chaos.☆12Oct 3, 2025Updated last year
- Notebooks for introductory lessons for learning TensorFlow 1.2 and Machine Learning☆17Aug 31, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- With AI Core as a proxy for Azure OpenAI Services, we are able to perform prompt engineering, e.g. to add more context in the form of (SA…☆38Mar 7, 2025Updated last year
- [NeurIPS '24 Spotlight] PertEval: Unveiling Real Knowledge Capacity of LLMs via Knowledge-invariant Perturbations☆14Oct 30, 2024Updated 2 years ago
- Multi-Agent LLM Evaluation Docs: https://maseval.readthedocs.io/☆41Oct 6, 2026Updated 3 weeks ago
- This is an AAAI-2026 conference paper repo.☆18Mar 1, 2026Updated 8 months ago
- ☆20Jan 9, 2025Updated last year
- ☆37Nov 10, 2021Updated 4 years ago
- Official GitHub repo for Scaling Physical Reasoning with the PHYSICS Dataset (NeurIPS25).☆17Sep 20, 2025Updated last year
- Skill library for Claude Code — opinionated rules and slash commands for modern ABAP (BTP ABAP Environment, S/4HANA 2023+ ABAP Cloud deve…☆34Aug 12, 2026Updated 2 months ago
- A curated resource for interactive evaluation: framework, taxonomy, design principles, and benchmark collection.☆24May 22, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated last month
- Official Repository for our paper: AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constra…☆28Sep 19, 2026Updated last month
- Code implementation for paper AbsenceBench: Language Models Can't Tell What's Missing☆19Oct 23, 2025Updated last year
- MLflow deployment plugin For IBM-cloud-watson-ml☆15May 7, 2025Updated last year
- Beagle is designed to be the unified platform for the broader Recursive Self-Improvement (RSI) ecosystem. Think of it as Hugging Face Tr…☆103Oct 23, 2026Updated last week
- SAP CPI Material☆47Jun 8, 2026Updated 4 months ago
- Official Spring AI support for latest watsonx.ai services☆27Updated this week
- One interface for your whole data stack, with built-in safeguards and a simpler workflow for your team. Written in Rust. Docker not neede…☆17Jul 30, 2026Updated 3 months ago
- ☆52May 4, 2026Updated 6 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Source code for the paper: Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention☆18Aug 14, 2026Updated 2 months ago
- AI agent whose purpose is to conduct vulnerability tests on LLMs from SAP AI Core or from local deployments, or models from HuggingFace. …☆46Aug 23, 2026Updated 2 months ago
- Claude Skill - SAP Private Cloud ERP Expert - RISE with SAP☆26Jul 22, 2026Updated 3 months ago
- A repository containing examples of AI paradigm implementations following best practices when building AI solutions with SAP services and…☆71Updated this week
- ☆11May 8, 2020Updated 6 years ago
- General purpose program synthetiser with existing Programming By Examples (PBE) pipeline☆25Jan 3, 2026Updated 10 months ago
- Code repository for CISO agent as part of ITBench☆22May 8, 2025Updated last year
- ACPBench: Reasoning about Action, Change, and Planning. A benchmark designed to evaluate the fundamental reasoning abilities in the dom…☆36Oct 16, 2026Updated 2 weeks ago
- Drive OSS standards and tools for data curation and evaluation creation for state of the art AI agents☆57Oct 21, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A function builder of OpenFunction. Base on https://github.com/GoogleCloudPlatform/buildpacks☆13Oct 27, 2026Updated last week
- A Topic Modeling algorithm that extracts the core topics from a text corpus. Implements the algorithm described in R. S. Randhawa, P. Jai…☆11Jan 7, 2017Updated 9 years ago
- [AAAI'25] The implementation of paper "Federated Foundation Models on Heterogeneous Time Series" | The first work to explore time series …☆24May 10, 2026Updated 5 months ago
- Official implementation of "DualTurn: Learning Turn-Taking from Dual-Channel Generative Speech Pretraining" (Interspeech 2026)☆13May 11, 2026Updated 5 months ago
- An open-source solution leveraging GitHub Actions to automate deployment for SAP Integration Suite. It standardizes CI/CD processes, supp…☆35Jun 3, 2026Updated 5 months ago
- ☆27Feb 28, 2025Updated last year
- A research framework for studying how multi-agent LLM teams complete software tasks given different team structures and sizes.☆16Apr 16, 2026Updated 6 months ago