Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Oct 24, 2024Updated 2 years ago
Alternatives and similar repositories for h2o-LLM-eval
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Dec 11, 2023Updated 2 years ago
- A simple repository showcasing a few LLM Evaluation strategies and leverages W&B Sweeps to optimize the LLM system.☆12Jul 11, 2023Updated 3 years ago
- ☆15Jun 27, 2023Updated 3 years ago
- Automate your blogging with AI-powered tools for creating, optimizing, and deploying content. Generate SEO-optimized articles effortlessl…☆12Aug 16, 2024Updated 2 years ago
- S2APLER: S2 Agglomeration of Papers with Low Error Rate (it's for academic paper clustering)☆24Jul 8, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Reference implementation for DPO (Direct Preference Optimization)☆13Jan 18, 2024Updated 2 years ago
- ☆11Mar 19, 2024Updated 2 years ago
- A tool library for riichi mahjong written in Rust, made mostly to be used as a WASM component.☆12Aug 29, 2025Updated last year
- SofaGenius: orchestrate agentic post-training☆12Apr 26, 2026Updated 6 months ago
- Scan your AI/ML models for problems before you put them into production.☆11Mar 31, 2025Updated last year
- This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.☆14May 2, 2024Updated 2 years ago
- ☆13Jul 20, 2021Updated 5 years ago
- The QA datasets used for DrQA evaluation.☆14Nov 30, 2018Updated 7 years ago
- Group-conditional DRO to alleviate spurious correlations☆15Jul 15, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Winning solution for the Kaggle Feedback Prize Challenge.☆68Sep 5, 2022Updated 4 years ago
- GPT API Cost Estimation for Enterprises☆15Oct 24, 2023Updated 3 years ago
- Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels☆10Oct 11, 2020Updated 6 years ago
- ☆28Jun 2, 2026Updated 5 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆87Oct 8, 2026Updated last month
- 百度网盘 Alfred workflow☆11Apr 23, 2021Updated 5 years ago
- A Discord bot that generates FULL powerpoints about a given subject thanks to openai's gpt3☆21Apr 17, 2023Updated 3 years ago
- ☆11Apr 21, 2022Updated 4 years ago
- Code for Engel, Grossmann & Ockenfels☆19Jan 2, 2026Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆45Jan 15, 2024Updated 2 years ago
- [COLM'24] How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?☆23Oct 13, 2024Updated 2 years ago
- ☆48Oct 22, 2024Updated 2 years ago
- ☆21Jun 27, 2024Updated 2 years ago
- FastAPI Microservices Architecture SDK - As Basis for multiple services in a platform/system