h2oai / h2o-LLM-eval
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Updated 6 months ago
Alternatives and similar repositories for h2o-LLM-eval:
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆128Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆77Updated 7 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆74Updated 6 months ago
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆94Updated 2 years ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆104Updated 6 months ago
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆27Updated 2 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 4 months ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Retrieval Augmented Generation Generalized Evaluation Dataset☆53Updated 5 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Updated 6 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆83Updated 8 months ago
- ☆51Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆96Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆106Updated 7 months ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆43Updated last year
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆24Updated 2 years ago
- ☆69Updated last year
- Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is al…☆111Updated last year
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆83Updated 4 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆66Updated 9 months ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆149Updated 11 months ago
- ☆19Updated 2 weeks ago
- ☆56Updated 7 months ago
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆56Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆150Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 2 months ago
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆46Updated last year