A light-weight tool for evaluating LLMs in rule-based ways.
☆86Jun 19, 2025Updated 11 months ago
Alternatives and similar repositories for MathRuler
Users that are interested in MathRuler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025] NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation☆110Sep 18, 2025Updated 8 months ago
- ☆22Sep 19, 2023Updated 2 years ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated 7 months ago
- ☆12Mar 22, 2025Updated last year
- mcp wrapper for openai built-in tools☆12Mar 13, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆12Nov 6, 2023Updated 2 years ago
- OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement☆149Apr 15, 2026Updated last month
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆147Nov 13, 2025Updated 6 months ago
- (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale☆49Jun 4, 2025Updated 11 months ago
- Constructing community of LLM-based Agent in the minecraft☆18Updated this week
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆14Oct 12, 2024Updated last year
- ☆42Jul 15, 2025Updated 10 months ago
- ☆47Apr 9, 2025Updated last year
- ☆10Feb 16, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A dataset of scientific vector graphics in TikZ for training generative models.☆27Feb 4, 2026Updated 3 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆80Oct 9, 2025Updated 7 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆214Updated this week
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆72Jul 8, 2025Updated 10 months ago
- AgentHub is the LLM API Hub for the Agent era, built for high-precision autonomous agents. (GPT-5.5/Claude 4.6/Gemini 3.1)☆89May 11, 2026Updated 2 weeks ago
- Unleashing the Power of Reinforcement Learning for Math and Code Reasoners☆745Jun 6, 2025Updated 11 months ago
- ☆58Jan 31, 2026Updated 3 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆4,950Apr 6, 2026Updated last month
- MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervision☆28May 26, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆55Apr 13, 2026Updated last month
- ☆29Jan 23, 2024Updated 2 years ago
- Toy implementation of Strawberry☆33Sep 24, 2024Updated last year
- Async pipelined version of Verl☆124Apr 8, 2025Updated last year
- Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"☆47Feb 19, 2026Updated 3 months ago
- [Findings of EMNLP'2024] Unified Active Retrieval for Retrieval Augmented Generation☆23Sep 30, 2024Updated last year
- ☆22Jul 9, 2025Updated 10 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆290Sep 25, 2025Updated 8 months ago
- Repository for Skill Set Optimization☆14Jul 26, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆843May 14, 2025Updated last year
- ☆52Oct 20, 2025Updated 7 months ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆74Jul 13, 2025Updated 10 months ago
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated last year
- Evaluation utilities based on SymPy.☆22Dec 12, 2024Updated last year
- DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models☆13Nov 2, 2023Updated 2 years ago
- MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension☆53Dec 3, 2024Updated last year