A comprehensive evaluation tool for verifying conversational AI applications.
☆18Oct 21, 2026Updated last week
Alternatives and similar repositories for AIEvaluationTool
Users that are interested in AIEvaluationTool are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated 2 years ago
- ☆15Jul 12, 2024Updated 2 years ago
- Machine learning models for prediction of chronic homelessness using the HIFIS Application.☆19Sep 19, 2026Updated last month
- Hindi NLP work☆14Apr 4, 2022Updated 4 years ago
- Responsible AI for the development sector☆18Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI Safety Graph☆18Mar 20, 2025Updated last year
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆25Oct 6, 2026Updated 3 weeks ago
- ☆25May 25, 2024Updated 2 years ago
- A comprehensive technical autopsy and archival index of the March 31, 2026 Anthropic Claude Code source leak. Documenting the "Agentic Ha…☆23Apr 1, 2026Updated 6 months ago
- ☆19Sep 17, 2018Updated 8 years ago
- The website of the Public AI Network☆28Updated this week
- ☆27May 20, 2025Updated last year
- ☆40May 8, 2026Updated 5 months ago
- comparing different blocking utilities☆57Jun 11, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆60Feb 11, 2025Updated last year
- ☆65Feb 12, 2024Updated 2 years ago
- ☆76Jun 16, 2026Updated 4 months ago
- EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…☆103Oct 5, 2026Updated 3 weeks ago
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆102Feb 7, 2026Updated 8 months ago
- ☆137Oct 20, 2026Updated last week
- Every Eval Ever is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation re…☆138Updated this week
- Code for the emrQA question answering dataset☆153Feb 9, 2022Updated 4 years ago
- ☆142Oct 28, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Steering vectors for transformer language models in Pytorch / Huggingface☆165Feb 21, 2025Updated last year
- Rapidly identify and mitigate container security vulnerabilities with generative AI.☆250Sep 9, 2026Updated last month
- METR Task Standard☆198Oct 7, 2026Updated 3 weeks ago
- Customizable, AI-driven virtual assistant designed to streamline customer service operations, handle common inquiries, and improve overal…☆282Oct 14, 2026Updated 2 weeks ago
- AI Verify☆103Mar 23, 2026Updated 7 months ago
- State-of-the-Art Language Modeling and Text Classification in Hindi Language☆219Mar 9, 2019Updated 7 years ago
- An AI-powered threat modeling tool that leverages OpenAI's GPT models to generate threat models for a given application based on the STRI…☆1,145Updated this week
- ☆316Oct 8, 2026Updated 3 weeks ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆258Oct 22, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A toolkit for describing model features and intervening on those features to steer behavior.☆270Mar 16, 2026Updated 7 months ago
- Open-source library for scalable, reproducible evaluation of AI models and benchmarks.☆355Oct 19, 2026Updated last week
- Public repository containing METR's DVC pipeline for eval data analysis☆343Mar 6, 2026Updated 7 months ago
- ☆359Jun 19, 2024Updated 2 years ago
- Following emerging Large Language Model Operations (LLM Ops) best practices in the industry, you’ll learn all about the key technologies …☆301Apr 11, 2024Updated 2 years ago
- ☆474Dec 27, 2023Updated 2 years ago
- My curriculum vitae (CV) written using LaTeX.☆960Sep 11, 2024Updated 2 years ago