A light-weight tool for evaluating LLMs in rule-based ways.
☆85Jun 19, 2025Updated 9 months ago
Alternatives and similar repositories for MathRuler
Users that are interested in MathRuler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025] NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation☆111Sep 18, 2025Updated 6 months ago
- ☆22Sep 19, 2023Updated 2 years ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated 6 months ago
- ☆12Mar 22, 2025Updated last year
- mcp wrapper for openai built-in tools☆12Mar 13, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆35Mar 6, 2026Updated last month
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆12Nov 6, 2023Updated 2 years ago
- (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale☆49Jun 4, 2025Updated 10 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆147Nov 13, 2025Updated 5 months ago
- Constructing community of LLM-based Agent in the minecraft☆17Nov 27, 2025Updated 4 months ago
- [ICLR2026] Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping☆63May 22, 2025Updated 10 months ago
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆12Oct 12, 2024Updated last year
- ☆41Jul 15, 2025Updated 9 months ago
- ☆47Apr 9, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Feb 16, 2025Updated last year
- A dataset of scientific vector graphics in TikZ for training generative models.☆26Feb 4, 2026Updated 2 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆78Oct 9, 2025Updated 6 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆206Apr 9, 2026Updated last week
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆73Jul 8, 2025Updated 9 months ago
- Unleashing the Power of Reinforcement Learning for Math and Code Reasoners☆744Jun 6, 2025Updated 10 months ago
- ☆53Jan 31, 2026Updated 2 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆4,831Apr 6, 2026Updated last week
- MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervision☆28May 26, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆42Feb 12, 2026Updated 2 months ago
- ☆29Jan 23, 2024Updated 2 years ago
- Async pipelined version of Verl☆125Apr 8, 2025Updated last year
- Toy implementation of Strawberry☆33Sep 24, 2024Updated last year
- Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"☆47Feb 19, 2026Updated last month
- [Findings of EMNLP'2024] Unified Active Retrieval for Retrieval Augmented Generation☆23Sep 30, 2024Updated last year
- ☆21Jul 9, 2025Updated 9 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆289Sep 25, 2025Updated 6 months ago
- Repository for Skill Set Optimization☆14Jul 26, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 📖 The starter kit for using Rippletide☆73Apr 2, 2026Updated last week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆844May 14, 2025Updated 11 months ago
- ☆27Jul 20, 2024Updated last year
- ☆51Oct 20, 2025Updated 5 months ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆73Jul 13, 2025Updated 9 months ago
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated last year
- Evaluation utilities based on SymPy.☆22Dec 12, 2024Updated last year