h2oai / h2o-LLM-eval
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆50Updated 2 months ago
Alternatives and similar repositories for h2o-LLM-eval:
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below
- Codebase accompanying the Summary of a Haystack paper.☆75Updated 3 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆124Updated 10 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆99Updated 3 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆116Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆66Updated 2 months ago
- ☆115Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated 11 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆82Updated 5 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆106Updated 3 weeks ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated 11 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆74Updated 2 months ago
- Just a bunch of benchmark logs for different LLMs☆116Updated 5 months ago
- Evaluating LLMs with CommonGen-Lite☆87Updated 9 months ago
- ☆46Updated 2 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆97Updated 4 months ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆90Updated last year
- ☆24Updated last year
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆42Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆79Updated 10 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆68Updated last month
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆129Updated 2 months ago
- ☆69Updated this week
- Using open source LLMs to build synthetic datasets for direct preference optimization☆49Updated 10 months ago
- Retrieval-Augmented Generation battle!☆48Updated last month
- ☆20Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆132Updated last month
- Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks☆50Updated 9 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 9 months ago
- ☆56Updated 3 months ago