h2oai / h2o-LLM-evalLinks
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Updated last year
Alternatives and similar repositories for h2o-LLM-eval
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below
Sorting:
- A set of utilities for running few-shot prompting experiments on large-language models☆126Updated 2 years ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆136Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆118Updated 2 months ago
- Retrieval Augmented Generation Generalized Evaluation Dataset☆59Updated 5 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆100Updated 2 years ago
- Reward Model framework for LLM RLHF☆61Updated 2 years ago
- AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness☆101Updated 11 months ago
- ☆129Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆111Updated last year
- This project studies the performance and robustness of language models and task-adaptation methods.☆155Updated last year
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆207Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆102Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆156Updated 2 years ago
- [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind☆66Updated 2 years ago
- Open Implementations of LLM Analyses☆107Updated last year
- ☆43Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆113Updated 6 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆87Updated last year
- Benchmark baseline for retrieval qa applications☆118Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆189Updated 5 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 4 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆125Updated 2 months ago
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆95Updated 2 years ago
- WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.☆57Updated this week
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆221Updated 2 years ago
- We believe the ability of an LLM to attribute the text that it generates is likely to be crucial for both system developers and users in …☆54Updated 2 years ago
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆109Updated last year