neelsjain / BYOD
The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
☆109Updated last year
Related projects ⓘ
Alternatives and complementary repositories for BYOD
- ☆112Updated last month
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆68Updated last year
- PASTA: Post-hoc Attention Steering for LLMs☆108Updated 2 months ago
- ☆151Updated 9 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆74Updated this week
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆78Updated 8 months ago
- ☆68Updated 3 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆62Updated 5 months ago
- Inspecting and Editing Knowledge Representations in Language Models☆108Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 8 months ago
- Codebase accompanying the Summary of a Haystack paper.☆72Updated 2 months ago
- AI Logging for Interpretability and Explainability🔬☆89Updated 5 months ago
- A framework for few-shot evaluation of autoregressive language models.☆101Updated last year
- ☆44Updated 2 months ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆107Updated last year
- ☆71Updated 6 months ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆85Updated last year
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆91Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆41Updated 9 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆62Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆95Updated last month
- ☆81Updated last year
- ☆46Updated this week
- Evaluating LLMs with fewer examples☆134Updated 7 months ago
- Retrieval Augmented Generation Generalized Evaluation Dataset☆51Updated this week
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆111Updated 2 months ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; arXiv preprint arXiv:2403.…☆37Updated 4 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆195Updated 2 weeks ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆129Updated this week
- ☆50Updated last year