Alternatives and similar repositories for h2o-LLM-eval

Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below

• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆126Updated 2 years ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆124Updated last month
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆117Updated last month
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆135Updated last year
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆58Updated 4 months ago
• vibrantlabsai / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆110Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆100Updated 2 years ago
• Edward-Sun / RECITE
  Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI
  ☆95Updated 2 years ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆156Updated 2 years ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆94Updated 9 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆155Updated last year
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆108Updated last year
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆117Updated 2 years ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 4 months ago
• jakespringer / echo-embeddings
  ☆159Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆112Updated 6 months ago
• bhargaviparanjape / language-programmes
  ☆173Updated 2 years ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆118Updated last year
• uclaml / Rephrase-and-Respond
  Official repo of Respond-and-Respond: data, code, and evaluation
  ☆104Updated last year
• olly-styles / WorkBench
  WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.
  ☆54Updated last year
• allenai / CommaQA
  Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents
  ☆24Updated 3 years ago
• microsoft / llm-data-creation
  Model, Code & Data for the EMNLP'23 paper "Making Large Language Models Better Data Creators"
  ☆137Updated 2 years ago
• SalesforceAIResearch / SFR-RAG
  ☆81Updated last month
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆101Updated 10 months ago