microsoft / MMLU-CF
A Contamination-free Multi-task Language Understanding Benchmark
☆114Updated 2 months ago
Alternatives and similar repositories for MMLU-CF:
Users that are interested in MMLU-CF are comparing it to the libraries listed below
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆154Updated 3 months ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆130Updated 3 weeks ago
- Code and dataset of CodeSteer☆53Updated this week
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆63Updated 5 months ago
- Collecting personality-indicative data for role-playing agents.☆22Updated last month
- SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation☆52Updated 4 months ago
- LLM Benchmark for Code☆31Updated 7 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated last week
- Mixed precision inference by Tensorrt-LLM☆78Updated 5 months ago
- A Contextual RAG Bot Framework☆81Updated 5 months ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆81Updated last week
- DPO-Shift: Shifting the Distribution of Direct Preference Optimization☆11Updated 3 weeks ago
- ☆76Updated last year
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response☆40Updated 3 months ago
- Enable AI agents to understand and execute any DeFi protocol operations☆76Updated 2 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 4 months ago
- [EMNLP 2024 Findings] Official PyTorch Implementation of "Adaptive Contrastive Search: Uncertainty-Guided Decoding for Open-Ended Text Ge…☆39Updated last month
- AutoRLAIF is a cutting-edge framework designed to revolutionize the fine-tuning of large language models through Reinforcement Learning …☆93Updated 5 months ago
- PyTorch code for BagFormer: Better Cross-Modal Retrieval via bag-wise interaction☆97Updated 2 years ago
- CoS: Chain-of-Shot Prompting for Long Video Understanding☆45Updated last month
- [COLING Demos 2025] an Easy-to-use Tool for Comprehensive Response Evaluation of LLMs☆37Updated 3 weeks ago
- Deliberate Reasoning in Language Models as Structure-Aware Planning with an Accurate World Model☆34Updated last month
- ☆47Updated 9 months ago
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆43Updated 8 months ago
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆292Updated 4 months ago
- Official Code of "GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question Answering"☆111Updated 5 months ago
- ☆29Updated 9 months ago
- Ein multimodaler, multi-intelligenter Entwicklungsrahmen☆45Updated 2 months ago
- [CVPR 2025] The official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆53Updated 3 weeks ago
- R1-like Computer-use Agent☆63Updated last week