Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Oct 24, 2024Updated last year
Alternatives and similar repositories for h2o-LLM-eval
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Dec 11, 2023Updated 2 years ago
- A simple repository showcasing a few LLM Evaluation strategies and leverages W&B Sweeps to optimize the LLM system.☆12Jul 11, 2023Updated 3 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- S2APLER: S2 Agglomeration of Papers with Low Error Rate (it's for academic paper clustering)☆23Jul 8, 2026Updated 2 months ago
- ☆50Apr 10, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Telegram bot utilizing OpenAI's GPT to generate presentations and abstracts in PPTX and DOCX formats.☆10Jan 10, 2024Updated 2 years ago
- papers of llm compression☆13Mar 6, 2024Updated 2 years ago
- ☆32Mar 11, 2026Updated 6 months ago
- ☆13Jul 30, 2024Updated 2 years ago
- ☆10Feb 12, 2024Updated 2 years ago
- This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.☆14May 2, 2024Updated 2 years ago
- ☆13Jul 20, 2021Updated 5 years ago
- Application for detecting functional groups of a molecules.☆17Jul 17, 2023Updated 3 years ago
- Run evals using LLM☆27Jan 8, 2026Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Source code of "Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers" EMNLP 2025☆18Jan 12, 2026Updated 8 months ago
- The QA datasets used for DrQA evaluation.☆14Nov 30, 2018Updated 7 years ago
- Code for Engel, Grossmann & Ockenfels☆19Jan 2, 2026Updated 8 months ago
- [NeurIPS VLM workshop 2024] In-Context Ensemble Learning from Pseudo Labels Improves Video-Language Models for Low-Level Workflow Underst…☆23Mar 16, 2025Updated last year
- Portable TCP/UDP/ICMP traceroute tool, written in Python☆18Apr 18, 2020Updated 6 years ago
- A refactoring benchmark for software engineering agents. [ICLR 2025]☆29Feb 20, 2026Updated 7 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆44Jan 15, 2024Updated 2 years ago
- A tool for automatic comparison and evaluation of RST trees☆12Aug 10, 2026Updated last month
- ☆28Jun 2, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆87Aug 12, 2024Updated 2 years ago
- Explore and Control with Adversarial Surprise☆10Jul 20, 2021Updated 5 years ago
- Group-conditional DRO to alleviate spurious correlations☆15Jul 15, 2021Updated 5 years ago
- Use LLM to help you in your reasearch☆16Jun 13, 2025Updated last year
- Transformer language model (GPT-2) with sentencepiece tokenizer☆10Oct 15, 2019Updated 6 years ago
- Opinionated Framework for Developing Packages 🤷☆10Apr 27, 2018Updated 8 years ago
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆21Aug 13, 2024Updated 2 years ago
- A simple tutorial script on Streamlit using the Iris Dataset☆13Sep 13, 2023Updated 3 years ago
- Encoder-decoders for translating different chemical formats.☆21Sep 17, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Oct 14, 2023Updated 2 years ago
- ☆22Oct 6, 2021Updated 4 years ago
- MediaWiki Categories Model☆13Feb 14, 2024Updated 2 years ago
- FastAPI Microservices Architecture SDK - As Basis for multiple services in a platform/system☆12Oct 4, 2022Updated 3 years ago
- Dataset and codes for identifying sentence-level discourse elements in Chinese argumentative student essays.☆14Nov 16, 2022Updated 3 years ago
- ☆13Jun 2, 2023Updated 3 years ago
- A Tutorial on RAG and Fine-Tuning LLMs☆15Nov 27, 2023Updated 2 years ago