gersteinlab / ML-BenchLinks
ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.09835)
☆301Updated 7 months ago
Alternatives and similar repositories for ML-Bench
Users that are interested in ML-Bench are comparing it to the libraries listed below
Sorting:
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆178Updated 2 months ago
- ☆150Updated this week
- When Agent Becomes the Scientist – Building Closed-Loop System from Hypothesis to Verification☆349Updated 2 weeks ago
- SQL-o1: A Self-Reward Heuristic Dynamic Search Method for Text-to-SQL☆185Updated last month
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆70Updated 2 weeks ago
- R1-like Computer-use Agent☆74Updated 3 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆136Updated 3 months ago
- From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery☆186Updated this week
- ☆101Updated 3 weeks ago
- Official Repository for Paper: The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning☆50Updated 2 months ago
- A clean and extensible agentic RAG system with modular implementation.☆104Updated last month
- BIRD-CRITIC 1.0: Can Large Language Models Solve USER SQL Issues in Real-World Database Applications?☆576Updated this week
- Codebase for Iterative DPO Using Rule-based Rewards☆247Updated 2 months ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling☆181Updated 3 weeks ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,193Updated 2 months ago
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆231Updated 2 weeks ago
- Code Efficiency Benchmark☆78Updated last month
- [ACL'25] Code for "Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering"☆20Updated 3 weeks ago
- Pytorch Library for Relational Table Learning with LLMs.☆431Updated 2 weeks ago
- DPO-Shift: Shifting the Distribution of Direct Preference Optimization☆59Updated 3 months ago
- [ICML2025] Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment☆104Updated last week
- ☆62Updated 3 months ago
- ☆206Updated 2 months ago
- DeepRetrieval - 🔥 Training Search Agent with Retrieval Outcomes via Reinforcement Learning☆569Updated last week
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning☆75Updated 2 months ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆143Updated last month
- (NeurIPS 2024) AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning☆206Updated 2 weeks ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆155Updated 6 months ago
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆93Updated last year
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆169Updated 6 months ago