gersteinlab / ML-Bench
The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.09835)
☆300Updated 5 months ago
Alternatives and similar repositories for ML-Bench
Users that are interested in ML-Bench are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆67Updated last week
- Code Efficiency Benchmark☆77Updated last week
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆176Updated last month
- Pytorch Library for Relational Table Learning with LLMs.☆429Updated this week
- SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writing☆141Updated last month
- R1-like Computer-use Agent☆70Updated last month
- Official Repository for Paper: The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning☆48Updated last month
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆135Updated 2 months ago
- BIRD-CRITIC 1.0: Can Large Language Models Solve USER SQL Issues in Real-World Database Applications?☆570Updated 2 weeks ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆155Updated 4 months ago
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,173Updated last month
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆196Updated 3 weeks ago
- DeepRetrieval - Hacking 🔥Real Search Engines and Retrievers with LLM via RL☆491Updated last week
- Source code for ICLR2025 paper "NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation".☆75Updated last month
- A clean and extensible agentic RAG system with modular implementation.☆97Updated 2 weeks ago
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆217Updated last month
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling [Work in Progress]☆89Updated last month
- ☆58Updated 2 months ago
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning☆69Updated 3 weeks ago
- DPO-Shift: Shifting the Distribution of Direct Preference Optimization☆58Updated 2 months ago
- A curated list of awesome leaderboard-oriented resources for foundation models☆262Updated 3 weeks ago
- Code for "Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering"☆17Updated 3 months ago
- ☆135Updated last month
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆93Updated last year
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆140Updated 3 weeks ago
- JittorGeometric is a Jittor-based graph machine learning library.☆154Updated 2 weeks ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆174Updated 6 months ago
- ☆45Updated last month
- A Contamination-free Multi-task Language Understanding Benchmark☆117Updated 3 weeks ago
- Codebase for Iterative DPO Using Rule-based Rewards☆245Updated last month