h2oai / h2o-LLM-eval
Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆50Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for h2o-LLM-eval
- Codebase accompanying the Summary of a Haystack paper.☆72Updated 2 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 8 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆113Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆61Updated 4 months ago
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆197Updated 6 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆64Updated last month
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆87Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆95Updated last month
- ☆112Updated last month
- ☆103Updated 3 months ago
- Dense X Retrieval: What Retrieval Granularity Should We Use?☆134Updated 10 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆115Updated last week
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆96Updated 7 months ago
- Open Implementations of LLM Analyses☆94Updated last month
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆77Updated 8 months ago
- Just a bunch of benchmark logs for different LLMs☆115Updated 3 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆124Updated 3 weeks ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆68Updated last month
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆64Updated 11 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆65Updated 4 months ago
- ☆83Updated last year
- This repository implements the chain of verification paper by Meta AI☆157Updated last year
- Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.☆168Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆82Updated 2 months ago
- Benchmark baseline for retrieval qa applications☆95Updated 7 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆129Updated this week
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆106Updated this week
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆100Updated 2 months ago
- [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind☆67Updated 11 months ago
- ReLM is a Regular Expression engine for Language Models☆104Updated last year