[ICLR'26, NAACL'25 Demo] Toolkit & Benchmark for evaluating the trustworthiness of generative foundation models.
☆136Oct 20, 2026Updated 2 weeks ago
Alternatives and similar repositories for TrustEval-toolkit
Users that are interested in TrustEval-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ValueLence: A Dashboard for In-Depth Value Probing of LLMs☆12Sep 12, 2025Updated last year
- ProbeLLM: Automating Principled Diagnosis of LLM Failures☆20Feb 11, 2026Updated 8 months ago
- [NeurIPS'25] ChemOrch: Empowering LLMs with Chemical Intelligence via Synthetic Instructions☆14Sep 23, 2025Updated last year
- [ICLR'25] DataGen: Unified Synthetic Dataset Generation via Large Language Models☆69Mar 8, 2025Updated last year
- RiskLab (ACL 2026 Demo): A Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems☆33Sep 30, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICLR'26] Building a Foundational Guardrail for General Agentic Systems via Synthetic Data☆49Oct 26, 2025Updated last year
- NeurIPS 2025 Poster☆26Feb 4, 2025Updated last year
- SDE-Harness (Scientific Discovery Evaluation Framework)☆65Oct 30, 2026Updated last week
- ACL 2025: Search-based multilingual LLM evaluation that discovers English-correct, target-language-wrong failures; code and 6,713-pair da…☆42Sep 21, 2026Updated last month
- Official implementation for the paper "Video-Based Reward Modeling for Computer-Use Agents"☆18Mar 14, 2026Updated 7 months ago
- [NeurIPS 2024] HonestLLM: Toward an Honest and Helpful Large Language Model☆29Jun 10, 2025Updated last year
- [EMNLP 2023] Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models☆28Dec 13, 2023Updated 2 years ago
- Final research artifacts from Épi: 106 improved constructions, 15 mathematical results, and their certificates.☆13Sep 14, 2026Updated last month
- NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models☆10Oct 27, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This repository contains a PyTorch implementation of the ICSE'26 paper "Scrub It Out! Erasing Sensitive Memorization in Code Language Mod…☆30Sep 18, 2025Updated last year
- ☆12Feb 7, 2026Updated 9 months ago
- [ICML25] CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale☆26Jul 31, 2025Updated last year
- Official Implementation for the paper "Discovering Knowledge Deficiencies of Language Models on Massive Knowledge Base"☆26Sep 2, 2025Updated last year
- From Agentic Intelligence to Interactive Intelligence. Give your AI agent a body and home.☆25Feb 22, 2026Updated 8 months ago
- A instruction data generation system for multimodal language models.☆37Jan 31, 2025Updated last year
- [CIKM 2024] Trojan Activation Attack: Attack Large Language Models using Activation Steering for Safety-Alignment.☆30Jul 29, 2024Updated 2 years ago
- ☆27Feb 28, 2023Updated 3 years ago
- CatchBench: a benchmark for auditing agent failures across the full lifecycle.☆12Oct 26, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆35Jul 11, 2024Updated 2 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- Code for paper: Optimizing Length Compression in Large Reasoning Models☆29Oct 20, 2025Updated last year
- [COLM'25] Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?☆41Jun 5, 2025Updated last year
- Official Code for ACL 2024 paper "GradSafe: Detecting Unsafe Prompts for LLMs via Safety-Critical Gradient Analysis"☆68Oct 27, 2024Updated 2 years ago
- MemoHarness: Agent Harnesses That Learn from Experience☆114Sep 26, 2026Updated last month
- ☆16Aug 30, 2025Updated last year
- AutoHallusion Codebase (EMNLP 2024)☆22Dec 6, 2024Updated last year
- [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.☆71Nov 27, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Does Socialization Emerge in AI Agent Society? A Case Study of Moltbook☆18Feb 17, 2026Updated 8 months ago
- [ICLR'24] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆121Mar 21, 2024Updated 2 years ago
- ☆16Nov 12, 2024Updated last year
- ☆18Jan 3, 2025Updated last year
- Load public agent-trajectory datasets and agent traces into one ATIF-based run record☆32Updated this week
- ☆51Feb 5, 2023Updated 3 years ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆47Jun 25, 2024Updated 2 years ago