h2oai / h2o-LLM-eval
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Updated 6 months ago
Alternatives and similar repositories for h2o-LLM-eval
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below
Sorting:
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆128Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆120Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 7 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆110Updated 8 months ago
- ☆38Updated 10 months ago
- CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments☆55Updated 2 months ago
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆24Updated 2 years ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Updated 6 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- ☆120Updated 7 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆83Updated 9 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 5 months ago
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆56Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆105Updated 7 months ago
- ☆69Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 10 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆76Updated 6 months ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆111Updated last year
- Retrieval Augmented Generation Generalized Evaluation Dataset☆53Updated 5 months ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆96Updated last year
- ☆57Updated 7 months ago
- ☆51Updated last year
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆203Updated 5 months ago
- Retrieval-Augmented Generation battle!☆50Updated 5 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆39Updated last year
- A repository for transformer critique learning and generation☆90Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- ☆48Updated 6 months ago
- ☆84Updated last year