FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
☆31Aug 14, 2025Updated last year
Alternatives and similar repositories for FBI
Users that are interested in FBI are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Generate large textual corpora for almost any language by crawling the web☆14Feb 17, 2024Updated 2 years ago
- A simple uv workspace☆19Apr 5, 2025Updated last year
- Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"☆24Feb 16, 2024Updated 2 years ago
- MetaQA: Combining Expert Agents for Multi-Skill Question Answering☆24Mar 13, 2022Updated 4 years ago
- Repository collecting resources and best practices to improve experimental rigour in deep learning research.☆27Mar 30, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆18Oct 9, 2025Updated last year
- Agile reading group that works☆13Feb 2, 2022Updated 4 years ago
- Code for the paper "Refining Language Model with Compositional Explanation" (NeurIPS 2021)☆11Oct 25, 2021Updated 5 years ago
- [NeurIPS 2025] PRISM is a multi-concept feature description framework which can identify and score polysemantic features.☆14Jun 26, 2026Updated 4 months ago
- [CCS 2024] Optimization-based Prompt Injection Attack to LLM-as-a-Judge☆41Sep 17, 2025Updated last year
- This repository contains implementation of CROSSGRAD (https://openreview.net/forum?id=r1Dx7fbCW) and DAN (https://arxiv.org/abs/1505.0781…☆24Dec 28, 2018Updated 7 years ago
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20May 14, 2022Updated 4 years ago
- Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"☆64Oct 26, 2024Updated 2 years ago
- ☆14Jun 18, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Face Recognition based attendance system for classroom environment. Developed a python API which recognizes the people in a picture(of a …☆15Dec 8, 2022Updated 3 years ago
- ☆14Oct 5, 2026Updated 3 weeks ago
- This repo contains the baseline model recipes and pre-trained model for GramVanni hindi ASR challenge☆16Mar 26, 2022Updated 4 years ago
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆12Mar 24, 2024Updated 2 years ago
- ☆56Nov 27, 2024Updated last year
- ☆25May 16, 2024Updated 2 years ago
- Datasets for compositional learning☆11Nov 28, 2018Updated 7 years ago
- Scripts for medium posts☆26Oct 28, 2019Updated 7 years ago
- Probing for Labeled Dependency Trees (ACL 2022) + Sorting LMs by Structure (NAACL 2022)☆10Jun 11, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Chrome Extension. As the name suggests.☆10Jan 30, 2022Updated 4 years ago
- Extendable toolkit for comprehensive evaluation of ASR systems. Currently supports benchmarking 29 system-models combination for Polish …☆12Mar 4, 2026Updated 7 months ago
- ☆44Dec 15, 2022Updated 3 years ago
- ☆11Jun 21, 2026Updated 4 months ago
- Court of XAI - A Python library for the systematic comparison of feature additive explanation methods.☆11May 30, 2023Updated 3 years ago
- Code associated with EMNLP 2024 paper - Are Large Language Models Good Classifiers? A Study on Edit Intent Classification in Scientific D…☆12Nov 21, 2024Updated last year
- Ludwig benchmark☆20May 11, 2026Updated 5 months ago
- Code for Evaluating Explanations for Reading Comprehension with Realistic Counterfactuals.☆17Apr 25, 2021Updated 5 years ago
- 🎯 Speech Recognition Challenge by Speech Lab - IIT Madras☆10Nov 5, 2020Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆12Jun 5, 2025Updated last year
- CSCW 2023 Best Demo Award: Conversational AI Explanations to Support Human-AI Scientific Writing☆15Jun 25, 2023Updated 3 years ago
- ☆10Dec 18, 2023Updated 2 years ago
- Takes care of your environment (variables) on AWS.☆12Dec 8, 2022Updated 3 years ago
- Fast Axiomatic Attribution for Neural Networks (NeurIPS*2021)☆15Feb 24, 2026Updated 8 months ago
- Data and codes for EMNLP 2022 paper "CDConv: A Benchmark for Contradiction Detection in Chinese Conversations"☆13May 8, 2023Updated 3 years ago
- Generalize then Adapt: Source-free Domain Adaptation for Semantic Segmentation (ICCV 2021)☆10Oct 12, 2021Updated 5 years ago