casmlab / NPHardEvalView external linksLinks
Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
☆63Mar 26, 2024Updated last year
Alternatives and similar repositories for NPHardEval
Users that are interested in NPHardEval are comparing it to the libraries listed below
Sorting:
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- benchmarks for evaluating MT models☆11Jun 26, 2024Updated last year
- An end-to-end benchmark suite of multi-modal DNN applications for system-architecture co-design☆22Dec 13, 2024Updated last year
- [ACL'24] Chain of Thought (CoT) is significant in improving the reasoning abilities of large language models (LLMs). However, the correla…☆47May 11, 2025Updated 9 months ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆28Updated this week
- ☆12Aug 8, 2023Updated 2 years ago
- Friday Agents. App: https://chat.toolstack.run/☆14Dec 18, 2024Updated last year
- Evaluating LLMs with CommonGen-Lite☆94Mar 21, 2024Updated last year
- ☆24Jun 18, 2025Updated 7 months ago
- ☆31Sep 28, 2025Updated 4 months ago
- 儿童故事常识推理与寓意理解评测（Commonsense Reasoning and Moral Understanding Evaluation in Children's Stories，CRMU）☆18Oct 22, 2024Updated last year
- This the implementation of LeCo☆31Jan 20, 2025Updated last year
- ☆30Feb 16, 2024Updated last year
- [ECCV 2024] M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts.☆61Oct 1, 2024Updated last year
- Unifew: Unified Fewshot Learning Model☆18Sep 10, 2021Updated 4 years ago
- The official implementation of NeurIPS 2021 paper: Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attacks☆17Jul 4, 2023Updated 2 years ago
- Download, parse, and filter data from Phil Papers. Data-ready for The-Pile.☆19Aug 28, 2023Updated 2 years ago
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Mar 16, 2023Updated 2 years ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Jun 3, 2024Updated last year
- Code base of In-Context Learning for Dialogue State tracking☆45Sep 24, 2023Updated 2 years ago
- Advanced Reasoning Benchmark Dataset for LLMs☆47Nov 19, 2023Updated 2 years ago
- ☆26Jul 13, 2023Updated 2 years ago
- [ICML2024]Adaptive decoding balances the diversity and coherence of open-ended text generation.☆19Jun 2, 2024Updated last year
- [ACL 2023] Delving into the Openness of CLIP☆24Jan 11, 2023Updated 3 years ago
- Feeling confused about super alignment? Here is a reading list☆44Jan 9, 2024Updated 2 years ago
- ☆52Jul 4, 2023Updated 2 years ago
- ☆19Dec 8, 2022Updated 3 years ago
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆22Oct 25, 2023Updated 2 years ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆147Sep 20, 2024Updated last year
- Track the progress of LLM context utilisation☆55Apr 14, 2025Updated 10 months ago
- ☆150Jan 4, 2024Updated 2 years ago
- ☆55Apr 1, 2024Updated last year
- Benchmarking Benchmark Leakage in Large Language Models☆58May 20, 2024Updated last year
- The world's first fully automated VC fund.☆28Feb 7, 2026Updated last week
- ☆27Mar 21, 2024Updated last year
- ☆37Jan 25, 2024Updated 2 years ago
- quick playground to animate pippin☆14Nov 11, 2024Updated last year
- Train Llama Loras Easily☆31Aug 3, 2023Updated 2 years ago
- [EMNLP2024] Benchmark for "Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark"☆35Sep 18, 2025Updated 4 months ago