Evaluating LLMs with CommonGen-Lite
☆94Mar 21, 2024Updated 2 years ago
Alternatives and similar repositories for CommonGen-Eval
Users that are interested in CommonGen-Eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆66Mar 26, 2024Updated 2 years ago
- LLM evaluation.☆15Nov 7, 2023Updated 3 years ago
- ☆24Jun 12, 2023Updated 3 years ago
- Advanced Reasoning Benchmark Dataset for LLMs☆47Nov 19, 2023Updated 2 years ago
- Automatically evaluate your LLMs in Google Colab☆699May 7, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆151Jan 4, 2024Updated 2 years ago
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆60Jun 2, 2026Updated 5 months ago
- A french litbank corpus☆10Jan 22, 2026Updated 9 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Aug 25, 2023Updated 3 years ago
- Character-based seq2seq models (english => predicate logic)☆16Dec 26, 2020Updated 5 years ago
- ☆10Jul 6, 2023Updated 3 years ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆261Nov 3, 2024Updated 2 years ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆90Jan 29, 2024Updated 2 years ago
- A cost estimator for OpenAI API calls in tqdm loops.☆20Nov 25, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆28Apr 21, 2023Updated 3 years ago
- Scrape and export data from the Open LLM Leaderboard.☆48Dec 17, 2024Updated last year
- Code for the paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers" with GPT-J implementation.☆15Mar 22, 2023Updated 3 years ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆25Oct 30, 2026Updated last week
- Query-focused summarization data☆44Feb 17, 2023Updated 3 years ago
- N/A☆19Aug 15, 2022Updated 4 years ago
- The Source Code for IF-VidCap @ICLR 2026☆18Oct 22, 2025Updated last year
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆27Nov 16, 2023Updated 2 years ago
- Knowledge Graph based Question Answering benchmark.☆10Feb 1, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Open-source AI for voice control, rivaling Alexa and Siri☆13Mar 9, 2024Updated 2 years ago
- ☆16Jul 20, 2023Updated 3 years ago
- Code Repo for "Differentiable Open-Ended Commonsense Reasoning" (NAACL 2021)☆33Jun 30, 2023Updated 3 years ago
- ☆40Mar 25, 2023Updated 3 years ago
- Evaluating LLMs with fewer examples☆186Jul 4, 2026Updated 4 months ago
- [ICLR 2025] This is the official implementation for the paper: "Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluat…☆47Jun 11, 2025Updated last year
- Using short models to classify long texts☆22Mar 8, 2023Updated 3 years ago
- Reference-Free automatic summarization evaluation and hallucination detection☆104Jan 15, 2024Updated 2 years ago
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆61Oct 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Using open-source LLM Llama2 by Meta on local CPU inference for document question-and-answer☆15Oct 5, 2023Updated 3 years ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆214Mar 5, 2024Updated 2 years ago
- ☆11Jun 23, 2025Updated last year
- Just a bunch of benchmark logs for different LLMs☆131Jul 28, 2024Updated 2 years ago
- Code for paper "Neural Semi-Markov Conditional Random Fields for Robust Character-Based Part-of-Speech Tagging"☆16May 31, 2019Updated 7 years ago
- A simple generate script utils using fastchat conv template for generation of Large Language Models☆21Jun 21, 2023Updated 3 years ago
- ☆14Apr 22, 2024Updated 2 years ago