h2oai/h2o-LLM-eval external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

h2oai/h2o-LLM-eval

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/h2oai/h2o-LLM-eval)

Close

h2oai / h2o-LLM-evalView on GitHubMore

• External links
• Readme badge

Large-language Model Evaluation framework with Elo Leaderboard and A-B testing

☆52Oct 24, 2024Updated last year

Alternatives and similar repositories for h2o-LLM-eval

Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below

• ayulockin / llm-eval-sweep

  View on GitHub
  A simple repository showcasing a few LLM Evaluation strategies and leverages W&B Sweeps to optimize the LLM system.
  ☆12Jul 11, 2023Updated 2 years ago
• SciMT / SciMT-benchmark

  View on GitHub
  ☆11Jan 3, 2024Updated 2 years ago
• hannahxchen / automatic-paraphrase-dataset-augmentation

  View on GitHub
  Code and data for automatic paraphrase dataset augmentation.
  ☆11Mar 8, 2021Updated 4 years ago
• ajesujoba / UNIQORN

  View on GitHub
  ☆13Jul 30, 2024Updated last year
• stanford-crfm / halie

  View on GitHub
  ☆17Dec 11, 2023Updated 2 years ago
• withmartian / leaderboard-backend

  View on GitHub
  Open sourced backend for Martian's LLM Inference Provider Leaderboard
  ☆21Aug 13, 2024Updated last year
• TheDuckAI / arb

  View on GitHub
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Nov 19, 2023Updated 2 years ago
• yuzu-ai / japanese-llm-ranking

  View on GitHub
  ☆50Apr 10, 2024Updated last year
• SalesforceAIResearch / swecomm

  View on GitHub
  ☆28Nov 10, 2025Updated 3 months ago
• edchengg / infoseek_eval

  View on GitHub
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25May 30, 2024Updated last year
• SALT-NLP / chain-of-thought-bias

  View on GitHub
  ☆28Sep 21, 2024Updated last year
• aiishii / JEMHopQA

  View on GitHub
  ☆29Apr 10, 2025Updated 10 months ago
• SalesforceAIResearch / Elastic-Reasoning

  View on GitHub
  Make reasoning models scalable
  ☆47May 31, 2025Updated 9 months ago
• izumi-h / ccgcomp

  View on GitHub
  Logical inference system based on event semantics and degree semantics in formal semantics
  ☆11Jan 22, 2023Updated 3 years ago
• juletx / self-translate

  View on GitHub
  Do Multilingual Language Models Think Better in English?
  ☆42Aug 3, 2023Updated 2 years ago
• IST-DASLab / SparseFinetuning

  View on GitHub
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Jan 15, 2024Updated 2 years ago
• transitive-bullshit / pnpm-update-catalogs

  View on GitHub
  pnpm update for pnpm workspace catalogs.
  ☆16Mar 25, 2025Updated 11 months ago
• ait-energy / iesopt

  View on GitHub
  Python wrapper for the energy system optimization framework IESopt.
  ☆18Updated this week
• dcarpintero / minerva

  View on GitHub
  Multi-Agent LLM System for Digital Scam Protection
  ☆12Dec 19, 2024Updated last year
• watayan / PyPEN

  View on GitHub
  WaPENの文法をPythonっぽくしたもの
  ☆14Updated this week
• zhimin-z / zhimin-z

  View on GitHub
  ☆12Jan 11, 2026Updated last month
• ruvnet / openai-cost-estimator

  View on GitHub
  GPT API Cost Estimation for Enterprises
  ☆13Oct 24, 2023Updated 2 years ago
• mingi3314 / blog-factory

  View on GitHub
  Automate your blogging with AI-powered tools for creating, optimizing, and deploying content. Generate SEO-optimized articles effortlessl…
  ☆12Aug 16, 2024Updated last year
• agno-agi / ai-app

  View on GitHub
  ☆12May 23, 2024Updated last year
• Finndersen / pydanticai_mcp_demo

  View on GitHub
  Demonstrate using MCP with Pydantic AI framework
  ☆14Mar 14, 2025Updated 11 months ago
• hanxlinsist / crawl_web

  View on GitHub
  Scrapy抓取豆瓣图书
  ☆10Aug 19, 2016Updated 9 years ago
• yaniv-golan / airtable-openapi-schema-generator

  View on GitHub
  A script that generates an OpenAPI 3.1.0 schema based on your Airtable base structure. This schema is designed for use with Custom GPT (C…
  ☆12Sep 26, 2024Updated last year
• antmachineintelligence / Feedback_1st

  View on GitHub
  ☆40Mar 30, 2022Updated 3 years ago
• cjerry1243 / M3Act

  View on GitHub
  [CVPR2024] Learning from Synthetic Human Group Activities
  ☆14Feb 24, 2025Updated last year
• jessety / wiegand-encoder

  View on GitHub
  Encode and decode 26-bit, 34-bit, or 38-bit Wiegand protocol credentials for communicating with access control systems in TypeScript or J…
  ☆12Sep 3, 2024Updated last year
• iSPIRT / depa-training

  View on GitHub
  ☆14Feb 11, 2026Updated 3 weeks ago
• spraakbanken / SuperLim-2

  View on GitHub
  A Swedish Natural Language Understanding Benchmark
  ☆11Dec 12, 2025Updated 2 months ago
• princeton-nlp / LM-Science-Tutor

  View on GitHub
  ☆49Aug 6, 2024Updated last year
• u2d-ai / msaSDK

  View on GitHub
  FastAPI Microservices Architecture SDK - As Basis for multiple services in a platform/system
  ☆12Oct 4, 2022Updated 3 years ago
• prajwalsouza / GPT-Store

  View on GitHub
  ☆11Jan 8, 2024Updated 2 years ago
• microsoft / sk-workshop

  View on GitHub
  Semantic Kernel Workshop
  ☆13Feb 20, 2026Updated 2 weeks ago
• mewstcom / mewst

  View on GitHub
  ほっとするマイクロブログ
  ☆14Feb 26, 2026Updated last week
• zhimin-z / Rigid-Body-Simulation

  View on GitHub
  ☆11Oct 15, 2022Updated 3 years ago
• nliulab / GenAI-Ethics-Checklist

  View on GitHub
  Transparent Reporting of Ethics for Generative AI (TREGAI) Checklist
  ☆15Oct 16, 2024Updated last year