microsoft / MMLU-CF
A Contamination-free Multi-task Language Understanding Benchmark
☆117Updated 3 months ago
Alternatives and similar repositories for MMLU-CF:
Users that are interested in MMLU-CF are comparing it to the libraries listed below
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆155Updated 3 months ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling [Work in Progress]☆71Updated this week
- SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation☆52Updated 4 months ago
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response☆40Updated 4 months ago
- Code and dataset of CodeSteer☆54Updated 3 weeks ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆82Updated 3 weeks ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆136Updated last month
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆42Updated 8 months ago
- Collecting personality-indicative data for role-playing agents.☆21Updated 2 months ago
- AutoRLAIF is a cutting-edge framework designed to revolutionize the fine-tuning of large language models through Reinforcement Learning …☆93Updated 5 months ago
- Official Implementation of AttentionShift: Iteratively Estimated Part-based Attention Map for Pointly Supervised Instance Segmentation☆158Updated 6 months ago
- LLM Benchmark for Code☆31Updated 8 months ago
- DPO-Shift: Shifting the Distribution of Direct Preference Optimization☆42Updated last month
- A Contextual RAG Bot Framework☆81Updated 5 months ago
- A curated list of awesome papers on the platonic representation hypothesis.☆20Updated this week
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆66Updated 5 months ago
- Mixed precision inference by Tensorrt-LLM☆79Updated 5 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated this week
- [COLING Demos 2025] an Easy-to-use Tool for Comprehensive Response Evaluation of LLMs☆37Updated last month
- Using reference images to control style in text-to-image diffusion models. Based on CSD and IP Adapter☆53Updated 3 weeks ago
- SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models☆40Updated last month
- Domain-Controlled Prompt Learning (AAAI2024)☆88Updated 5 months ago
- ☆76Updated last year
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 5 months ago
- An easy-to-use vector database.☆36Updated 2 weeks ago
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning☆31Updated this week
- Enable AI agents to understand and execute any DeFi protocol operations☆77Updated 3 months ago
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆140Updated 2 months ago
- [AAAI 2025] Code for paper:Enhancing Multimodal Large Language Models Complex Reasoning via Similarity Computation☆2Updated 3 months ago
- Support mixed-precsion inference with vllm☆83Updated 3 months ago