h2oai / h2o-LLM-eval
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆50Updated 3 months ago
Alternatives and similar repositories for h2o-LLM-eval:
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below
- Codebase accompanying the Summary of a Haystack paper.☆74Updated 5 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Updated 4 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆83Updated 6 months ago
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆45Updated last year
- Open Implementations of LLM Analyses☆98Updated 4 months ago
- Benchmark baseline for retrieval qa applications☆100Updated 10 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆102Updated 4 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆65Updated 7 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆67Updated 4 months ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆94Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆82Updated last week
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆63Updated last year
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆201Updated 2 months ago
- Advanced Reasoning Benchmark Dataset for LLMs☆45Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆101Updated 2 months ago
- Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks☆54Updated 10 months ago
- Reward Model framework for LLM RLHF☆60Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 7 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆135Updated 3 months ago
- ☆117Updated 4 months ago
- Retrieval Augmented Generation Generalized Evaluation Dataset☆51Updated 3 months ago
- codebase release for EMNLP2023 paper publication☆19Updated 11 months ago
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆69Updated last year
- ☆57Updated 4 months ago
- ☆15Updated last year
- [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind☆67Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Updated last year
- Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…☆62Updated 8 months ago