IBM / benchbenchLinks
A package dedicated for running benchmark agreement testing
☆16Updated 3 weeks ago
Alternatives and similar repositories for benchbench
Users that are interested in benchbench are comparing it to the libraries listed below
Sorting:
- A curated list of research papers and resources on Cultural LLM.☆44Updated 8 months ago
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 8 months ago
- Code for Zero-Shot Tokenizer Transfer☆128Updated 4 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- ☆57Updated 8 months ago
- ☆29Updated 10 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆128Updated last year
- Repository for the ACL 2024 conference website☆18Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆47Updated 6 months ago
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆76Updated last year
- ☆121Updated 8 months ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆44Updated 11 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆21Updated 9 months ago
- ☆38Updated last year
- Learning to route instances for Human vs AI Feedback (ACL 2025 Main)☆23Updated 3 weeks ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆58Updated last year
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆23Updated last month
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆33Updated 5 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆58Updated last year
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆47Updated 4 months ago
- Code and Data for the NAACL 24 paper: MacGyver: Are Large Language Models Creative Problem Solvers?☆28Updated last year
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆56Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 9 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆81Updated 9 months ago
- ☆106Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆14Updated 3 weeks ago