FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
☆31Aug 14, 2025Updated last year
Alternatives and similar repositories for FBI
Users that are interested in FBI are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple lightweight library for text normalization for Indian Languages☆23Sep 30, 2025Updated last year
- Website of The 3rd Workshop on UAVs in Multimedia: Capturing the World from a New Perspective☆15Nov 4, 2025Updated last year
- Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"☆24Feb 16, 2024Updated 2 years ago
- MetaQA: Combining Expert Agents for Multi-Skill Question Answering☆24Mar 13, 2022Updated 4 years ago
- Repository collecting resources and best practices to improve experimental rigour in deep learning research.☆27Mar 30, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Reso…☆18Oct 9, 2025Updated last year
- ☆14May 25, 2021Updated 5 years ago
- [CCS 2024] Optimization-based Prompt Injection Attack to LLM-as-a-Judge☆41Sep 17, 2025Updated last year
- Code for EMNLP 2022 Paper: On the Calibration of Massively Multilingual Language Models☆15Jun 12, 2023Updated 3 years ago
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20May 14, 2022Updated 4 years ago
- This repository contains implementation of CROSSGRAD (https://openreview.net/forum?id=r1Dx7fbCW) and DAN (https://arxiv.org/abs/1505.0781…☆24Dec 28, 2018Updated 7 years ago
- The Codebase for Causal Proxy Model☆12Sep 29, 2022Updated 4 years ago
- Generate realistic and diverse user personas for LLM agent benchmarks.☆13Oct 18, 2026Updated last month
- ☆28Jul 20, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [EMNLP 2022] Multilingual Relation Classification via Efficient and Effective Prompting☆10Oct 11, 2022Updated 4 years ago
- Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"☆64Oct 26, 2024Updated 2 years ago
- UI for ActivityWatch. Include category editor and viewer for multiple categorizations.☆10Jan 31, 2024Updated 2 years ago
- Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tool…☆12Mar 24, 2024Updated 2 years ago
- HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checking☆16Apr 11, 2025Updated last year
- VertMetric: An abstractive summarization evaluation package. VERT stands for Versatile Evaluation of Reduced Texts.☆12Dec 20, 2018Updated 7 years ago
- Scripts for medium posts☆26Oct 28, 2019Updated 7 years ago
- Chrome Extension. As the name suggests.☆10Jan 30, 2022Updated 4 years ago
- Help creating image dataset for machine learning.☆10Nov 4, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆56Nov 27, 2024Updated last year
- ☆25May 16, 2024Updated 2 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆26Oct 29, 2026Updated 3 weeks ago
- ☆14Jun 18, 2026Updated 5 months ago
- 삼각형의 실전! Triton☆16Feb 15, 2024Updated 2 years ago
- Extendable toolkit for comprehensive evaluation of ASR systems. Currently supports benchmarking 29 system-models combination for Polish …☆12Mar 4, 2026Updated 8 months ago
- ☆11Nov 13, 2026Updated last week
- [EMNLP 2024] MixGR: Enhancing Retriever Generalization for Scientific Domain through Complementary Granularity☆12Jul 16, 2024Updated 2 years ago
- Code and Data for PeerQA: A Scientific Question Answering Dataset from Peer Reviews, NAACL 2025 https://aclanthology.org/2025.naacl-long.…☆18Jun 1, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This repo contains the baseline model recipes and pre-trained model for GramVanni hindi ASR challenge☆16Mar 26, 2022Updated 4 years ago
- Ludwig benchmark☆20May 11, 2026Updated 6 months ago
- ☆45Dec 15, 2022Updated 3 years ago
- 🎯 Speech Recognition Challenge by Speech Lab - IIT Madras☆10Nov 5, 2020Updated 6 years ago
- Code for "The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation", NeurIPS 2025☆12Jan 20, 2026Updated 10 months ago
- Code for Evaluating Explanations for Reading Comprehension with Realistic Counterfactuals.☆17Apr 25, 2021Updated 5 years ago
- [NeurIPS 2025] PRISM is a multi-concept feature description framework which can identify and score polysemantic features.☆14Jun 26, 2026Updated 4 months ago
Are these results useful?