AI4Bharat / FBI
FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
☆28Updated last month
Alternatives and similar repositories for FBI:
Users that are interested in FBI are comparing it to the libraries listed below
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Codebase accompanying the Summary of a Haystack paper.☆77Updated 7 months ago
- ☆40Updated 8 months ago
- ☆33Updated 2 weeks ago
- Simple Model Similarities Analysis☆21Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆84Updated 5 months ago
- ☆41Updated 3 weeks ago
- Code for Zero-Shot Tokenizer Transfer☆127Updated 3 months ago
- ☆44Updated 5 months ago
- ☆56Updated 7 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 9 months ago
- IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …☆46Updated 7 months ago
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆64Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated last year
- LLM attention pattern visualizer☆10Updated last year
- List of papers on Self-Correction of LLMs.☆72Updated 3 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆74Updated last year
- ☆16Updated 6 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆25Updated 4 months ago
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆108Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- ☆24Updated last year
- Measuring and Controlling Persona Drift in Language Model Dialogs☆17Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆70Updated 3 weeks ago
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆28Updated this week
- Aioli: A unified optimization framework for language model data mixing☆23Updated 3 months ago
- The first dense retrieval model that can be prompted like an LM☆71Updated 7 months ago
- ☆19Updated 2 weeks ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆108Updated 2 months ago