h2oai / h2o-LLM-evalLinks
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Updated 9 months ago
Alternatives and similar repositories for h2o-LLM-eval
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below
Sorting:
- A set of utilities for running few-shot prompting experiments on large-language models☆122Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆114Updated 3 weeks ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆115Updated 10 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆131Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆105Updated 7 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 9 months ago
- Retrieval Augmented Generation Generalized Evaluation Dataset☆54Updated 3 weeks ago
- Reward Model framework for LLM RLHF☆61Updated 2 years ago
- ☆85Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆97Updated last year
- This project studies the performance and robustness of language models and task-adaptation methods.☆150Updated last year
- ☆125Updated 10 months ago
- ☆152Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆99Updated this week
- ☆77Updated 6 months ago
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆204Updated 7 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 9 months ago
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆152Updated last year
- Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is al…☆111Updated last year
- ☆172Updated 2 years ago
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 5 months ago
- WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.☆43Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- ☆41Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆108Updated 2 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆185Updated last month
- [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models☆28Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆93Updated 8 months ago
- [NAACL 2024] Struc-Bench: Are Large Language Models Good at Generating Complex Structured Tabular Data? https://aclanthology.org/2024.naa…☆54Updated last week