This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
☆51Oct 31, 2024Updated last year
Alternatives and similar repositories for Mr-Ben
Users that are interested in Mr-Ben are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Jul 12, 2025Updated 9 months ago
- ☆33Sep 14, 2025Updated 7 months ago
- This the implementation of LeCo☆32Jan 20, 2025Updated last year
- ☆16Jul 29, 2024Updated last year
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…☆30Nov 24, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Lightweight tool to identify Data Contamination in LLMs evaluation☆53Mar 8, 2024Updated 2 years ago
- Challenge LLMs to Reason About Reasoning: A Benchmark to Unveil Cognitive Depth in LLMs☆52Jul 10, 2024Updated last year
- ☆51Oct 28, 2024Updated last year
- [NeurIPS 2025] Scaling Language-centric Omnimodal Representation Learning☆38Feb 6, 2026Updated 2 months ago
- Efficient triton implementation of Native Sparse Attention.☆274May 23, 2025Updated 10 months ago
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Feb 9, 2025Updated last year
- ☆25Aug 23, 2024Updated last year
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆153Sep 21, 2024Updated last year
- Code repo for FaStfact: Faster, Stronger Long-Form Factuality Evaluations in LLMs.☆32Nov 5, 2025Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Neural Code Intelligence Survey 2024-25; Reading lists and resources☆283Jul 24, 2025Updated 8 months ago
- ☆28May 8, 2024Updated last year
- Codebase for Instruction Following without Instruction Tuning☆36Sep 24, 2024Updated last year
- A collection of papers tackling automatic fact-checking (particularly of AI-generated content)☆13Nov 3, 2023Updated 2 years ago
- The code and data for ACL2021 paper <Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA?>☆22Dec 18, 2022Updated 3 years ago
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆13Aug 8, 2025Updated 8 months ago
- Knowledge Distillation Toolbox for Semantic Segmentation☆17Nov 20, 2022Updated 3 years ago
- [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆31Apr 8, 2024Updated 2 years ago
- ☆20Apr 3, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICML 2025] Official repository for paper "OR-Bench: An Over-Refusal Benchmark for Large Language Models"☆26Mar 4, 2025Updated last year
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences☆44Mar 11, 2025Updated last year
- Code for "From Ideal to Real: Unified and Data-Efficient Dense Prediction for Real-World Scenarios"☆28Jul 7, 2025Updated 9 months ago
- Aioli: A unified optimization framework for language model data mixing☆32Jan 17, 2025Updated last year
- This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"☆55Jul 16, 2024Updated last year
- Official PyTorch implementation of Time-aware Large Kernel (TaLK) Convolutions (ICML 2020)☆29Dec 9, 2020Updated 5 years ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆23Feb 10, 2026Updated 2 months ago
- Encodings for neural architecture search☆29Apr 5, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Offline RL experiments☆15Oct 1, 2022Updated 3 years ago
- The second Homework of NLP☆13Jun 9, 2021Updated 4 years ago
- ☆16Nov 26, 2024Updated last year
- ☆14Jun 9, 2021Updated 4 years ago
- Python tools☆14Oct 22, 2023Updated 2 years ago
- Repository for the Adversarial ML on Code things☆16Jun 25, 2020Updated 5 years ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆49Jan 21, 2025Updated last year