A comprehensive evaluation tool for verifying conversational AI applications.
☆16Jul 20, 2026Updated this week
Alternatives and similar repositories for AIEvaluationTool
Users that are interested in AIEvaluationTool are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jul 12, 2024Updated 2 years ago
- Core engine behind Calibrate, a framework for evaluating AI agents: speech-to-text, text-to-speech, LLM evaluation, end-to-end simulation…☆16Updated this week
- Machine learning models for prediction of chronic homelessness using the HIFIS Application.☆19Jul 10, 2024Updated 2 years ago
- GLaRA: Graph-based Labeling Rule Augmentation for Weakly Supervised Named Entity Recognition☆31Jan 31, 2022Updated 4 years ago
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆25Jan 26, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Responsible AI for the development sector☆18Updated this week
- ☆25May 25, 2024Updated 2 years ago
- ☆19Sep 17, 2018Updated 7 years ago
- ☆27May 20, 2025Updated last year
- Online Recruitment System for Economic Experiments☆38Jun 18, 2026Updated last month
- comparing different blocking utilities☆57Jun 11, 2021Updated 5 years ago
- ☆73Jun 16, 2026Updated last month
- ☆63Feb 12, 2024Updated 2 years ago
- A Python Natural Language Processing Toolkit for Medical Text Generation☆84May 24, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…☆102Apr 9, 2026Updated 3 months ago
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆100Feb 7, 2026Updated 5 months ago
- ☆129Jun 10, 2026Updated last month
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆96May 15, 2024Updated 2 years ago
- 🐮 Build decentralized multi-agent systems with dynamic agent-to-agent messaging and collaboration☆143Updated this week
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆119Jun 13, 2024Updated 2 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆157Feb 21, 2025Updated last year
- ☆141Oct 28, 2023Updated 2 years ago
- AI Verify☆81Mar 23, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Customizable, AI-driven virtual assistant designed to streamline customer service operations, handle common inquiries, and improve overal…☆269Jun 1, 2026Updated last month
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆210Updated this week
- ☆346Jun 19, 2024Updated 2 years ago
- ☆414Jul 2, 2024Updated 2 years ago
- Public repository containing METR's DVC pipeline for eval data analysis☆301Mar 6, 2026Updated 4 months ago
- Following emerging Large Language Model Operations (LLM Ops) best practices in the industry, you’ll learn all about the key technologies …☆295Apr 11, 2024Updated 2 years ago
- OWASP Foundation Web Respository☆402Updated this week
- Extendable HPC-Framework for CUDA, OpenCL and common CPU☆482Apr 23, 2016Updated 10 years ago
- Deliver safe & effective language models☆563Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆595Jul 19, 2024Updated 2 years ago
- ☆591Jun 26, 2025Updated last year
- Late Interaction Models Training & Retrieval☆875Jul 13, 2026Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,817May 28, 2026Updated last month
- Collection of evals for Inspect AI☆591Updated this week
- Generative AI on AWS☆641Oct 9, 2024Updated last year
- Generate High-Quality Synthetics, Train, Measure, and Evaluate in a Single Pipeline☆877Updated this week