microsoft / MMLU-CF
A Contamination-free Multi-task Language Understanding Benchmark
☆113Updated last month
Alternatives and similar repositories for MMLU-CF:
Users that are interested in MMLU-CF are comparing it to the libraries listed below
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆152Updated last month
- Mixed precision inference by Tensorrt-LLM☆76Updated 3 months ago
- SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation☆51Updated 2 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆172Updated 3 months ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆62Updated 3 months ago
- LLM Benchmark for Code☆31Updated 6 months ago
- (NeurIPS 2024) Learning to Visual Question Answering, Asking and Assessment☆73Updated this week
- Collecting personality-indicative data for role-playing agents.☆22Updated this week
- A Contextual RAG Bot Framework☆79Updated 3 months ago
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆42Updated 6 months ago
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response☆40Updated 2 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 3 months ago
- ☆72Updated last year
- ☆76Updated 10 months ago
- [COLING Demos 2025] an Easy-to-use Tool for Comprehensive Response Evaluation of LLMs☆38Updated 2 months ago
- Rethinking Video-Text Understanding Retrieval from Counterfactually Augmented Data☆39Updated 6 months ago
- [EMNLP 2024 Findings] Official PyTorch Implementation of "Adaptive Contrastive Search: Uncertainty-Guided Decoding for Open-Ended Text Ge…☆39Updated this week
- Official Implementation of AttentionShift: Iteratively Estimated Part-based Attention Map for Pointly Supervised Instance Segmentation☆158Updated 4 months ago
- Deliberate Reasoning for LLMs as Structure-aware Planning with Accurate World Model☆30Updated this week
- [AAAI 2025] Code for paper:Enhancing Multimodal Large Language Models Complex Reasoning via Similarity Computation☆30Updated last month
- Empower Your Model with Longer and Better Context Comprehention☆40Updated last year
- The official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆46Updated 2 months ago
- official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training☆30Updated 2 months ago
- AutoRLAIF is a cutting-edge framework designed to revolutionize the fine-tuning of large language models through Reinforcement Learning …☆93Updated 3 months ago
- SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editing☆34Updated last year
- [NeurIPS 2024] EffiBench: Benchmarking the Efficiency of Automatically Generated Code☆51Updated 2 months ago
- linkedin, seek job information crawler☆79Updated 4 months ago