Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
☆66Mar 26, 2024Updated 2 years ago
Alternatives and similar repositories for NPHardEval
Users that are interested in NPHardEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Contextualized Logic☆13Jun 8, 2024Updated 2 years ago
- LLM evaluation.☆15Nov 7, 2023Updated 3 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Oct 26, 2026Updated last week
- Evaluating LLMs with CommonGen-Lite☆94Mar 21, 2024Updated 2 years ago
- Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Langu…☆38Dec 18, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆12Sep 23, 2023Updated 3 years ago
- ☆14Aug 15, 2024Updated 2 years ago
- ModSleuth builds evidence-grounded dependency graphs for LLM releases from public artifacts such as model cards, dataset cards, technical…☆17Jun 15, 2026Updated 4 months ago
- Metrics for "Beyond neural scaling laws: beating power law scaling via data pruning " (NeurIPS 2022 Outstanding Paper Award)☆58Apr 24, 2023Updated 3 years ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- a benckmark for evaluating logical reasoning of LLMs☆23Jan 25, 2024Updated 2 years ago
- ☆17Feb 22, 2024Updated 2 years ago
- [ICLR 2025 DATA-FM] Training and Evaluating Language Models with Template-based Data Generation (https://arxiv.org/abs/2411.18104)☆13May 13, 2026Updated 5 months ago
- TrustAgent: Towards Safe and Trustworthy LLM-based Agents☆62Feb 7, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆18Jul 12, 2025Updated last year
- EmojiCrypt: Prompt Encryption for Secure Communication with Large Language Models☆27Feb 21, 2024Updated 2 years ago
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆27Nov 16, 2023Updated 2 years ago
- Models That Prove Their Own Correctness☆12Dec 11, 2024Updated last year
- This the implementation of LeCo☆33Jan 20, 2025Updated last year
- Bayes-Adaptive RL for LLM Reasoning☆47May 28, 2025Updated last year
- ☆11Mar 15, 2025Updated last year
- ☆11Mar 24, 2024Updated 2 years ago
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆117Jan 11, 2026Updated 9 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Repository for Skill Set Optimization☆14Jul 26, 2024Updated 2 years ago
- A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models☆29Nov 25, 2024Updated last year
- Data and code for paper "M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Models"☆105Jun 15, 2023Updated 3 years ago
- 儿童故事常识推理与寓意理解评测（Commonsense Reasoning and Moral Understanding Evaluation in Children's Stories，CRMU）☆18Oct 22, 2024Updated 2 years ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- [ICLR 2025] Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist☆34Oct 23, 2024Updated 2 years ago
- 🧘 BLISS – a Benchmark for Language Induction from Small Sets☆13Sep 10, 2023Updated 3 years ago
- [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.☆88Nov 2, 2025Updated last year
- AlphaVerus: Formally Verified Code Generation through Self-Improving Translation and Treefinement☆35May 14, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML 2025] ReflectionBench: Evaluating Epistemic Agency in Large Language Models☆23Jun 24, 2025Updated last year
- AI for Mathematics Paper List☆18Jan 14, 2025Updated last year
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Mar 16, 2023Updated 3 years ago
- Code3DBench: Single-Image to Executable Low-Poly 3D Code Generation☆13Jun 6, 2026Updated 5 months ago
- The official implementation of Preference Data Reward-Augmentation.☆18May 1, 2025Updated last year
- MATCH-TUNING☆15Aug 6, 2022Updated 4 years ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆32Mar 5, 2024Updated 2 years ago