Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
☆52Oct 24, 2024Updated last year
Alternatives and similar repositories for h2o-LLM-eval
Users that are interested in h2o-LLM-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code and data for automatic paraphrase dataset augmentation.☆11Mar 8, 2021Updated 5 years ago
- Diverse collection of 100 Hydrogen Torch Use-Cases by different industries, data-types, and problem types☆11Oct 10, 2024Updated last year
- ☆18Dec 11, 2023Updated 2 years ago
- A simple repository showcasing a few LLM Evaluation strategies and leverages W&B Sweeps to optimize the LLM system.☆12Jul 11, 2023Updated 3 years ago
- RSNA 2022 - Cervical Spine Fracture Detection - Identify cervical fractures from scans☆15Nov 7, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆11Jan 3, 2024Updated 2 years ago
- S2APLER: S2 Agglomeration of Papers with Low Error Rate (it's for academic paper clustering)☆22Jul 8, 2026Updated 2 months ago
- ☆50Apr 10, 2024Updated 2 years ago
- ☆10Mar 19, 2024Updated 2 years ago
- ⏱ A Google Chrome extension for keeping track of who is talking during Google Meets☆12Aug 17, 2023Updated 3 years ago
- ☆29Sep 12, 2021Updated 4 years ago
- ☆13Jul 30, 2024Updated 2 years ago
- This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.☆14May 2, 2024Updated 2 years ago
- Run evals using LLM☆27Jan 8, 2026Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [NeurIPS VLM workshop 2024] In-Context Ensemble Learning from Pseudo Labels Improves Video-Language Models for Low-Level Workflow Underst…☆23Mar 16, 2025Updated last year
- ☆18Aug 15, 2023Updated 3 years ago
- Portable TCP/UDP/ICMP traceroute tool, written in Python☆17Apr 18, 2020Updated 6 years ago
- Code for PCA-OGD (AISTATS 2021)☆11Mar 16, 2021Updated 5 years ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆44Jan 15, 2024Updated 2 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆87Aug 12, 2024Updated 2 years ago
- Explore and Control with Adversarial Surprise☆10Jul 20, 2021Updated 5 years ago
- IDRISI is the largest-scale publicly-available Twitter Location Mention Prediction (LMP) datasets, in both English and Arabic languages. …☆23Aug 12, 2025Updated last year
- Transformer language model (GPT-2) with sentencepiece tokenizer☆10Oct 15, 2019Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆21Jun 27, 2024Updated 2 years ago
- [COLM'24] How Easily do Irrelevant Inputs Skew the Responses of Large Language Models?☆23Oct 13, 2024Updated last year
- Extract Stats Q/A from Tables With Provenance☆26Aug 31, 2026Updated last week
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆21Aug 13, 2024Updated 2 years ago
- Implementation of SAHI with YoloX☆15Mar 1, 2022Updated 4 years ago
- Encoder-decoders for translating different chemical formats.☆21Sep 17, 2025Updated 11 months ago
- ☆10Oct 14, 2023Updated 2 years ago
- ☆23Nov 8, 2023Updated 2 years ago
- Reinforcement Learning Robot avoiding obstacles(Python + V_rep)☆12Oct 29, 2019Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆22Oct 6, 2021Updated 4 years ago
- The best terminal chat client for your live streams☆19Jun 10, 2023Updated 3 years ago
- ☆13Jun 2, 2023Updated 3 years ago
- A Tutorial on RAG and Fine-Tuning LLMs☆15Nov 27, 2023Updated 2 years ago
- Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking☆13Feb 5, 2023Updated 3 years ago
- This repo contains code for paper: "Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach".☆26Oct 21, 2024Updated last year
- Dynamic Simulation Environments for Reinforcement Learning☆13Apr 17, 2021Updated 5 years ago