gersteinlab / ML-Bench
The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.09835)
☆299Updated 5 months ago
Alternatives and similar repositories for ML-Bench:
Users that are interested in ML-Bench are comparing it to the libraries listed below
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated last week
- Code Efficiency Benchmark☆77Updated 3 months ago
- Pytorch Library for Relational Table Learning with LLMs.☆428Updated this week
- BIRD-CRITIC 1.0: Can Large Language Models Solve USER SQL Issues in Real-World Database Applications?☆445Updated this week
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆133Updated last month
- R1-like Computer-use Agent☆67Updated last month
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆202Updated 3 weeks ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆66Updated 5 months ago
- Official Repository for Paper: The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning☆47Updated last week
- DeepRetrieval - Hacking 🔥Real Search Engines and Retrievers with LLM via RL☆423Updated last week
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆190Updated last month
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆1,171Updated 3 weeks ago
- A clean and extensible agentic RAG system with modular implementation.☆94Updated last week
- SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writing☆137Updated last month
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆166Updated 4 months ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling [Work in Progress]☆77Updated last week
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆156Updated 4 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆240Updated 2 weeks ago
- A curated list of awesome leaderboard-oriented resources for foundation models☆259Updated last week
- A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.☆198Updated 10 months ago
- ☆55Updated last month
- JittorGeometric is a Jittor-based graph machine learning library.☆153Updated last week
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning☆63Updated this week
- ☆135Updated 2 weeks ago
- Source code for ICLR2025 paper "NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation".☆74Updated 2 weeks ago
- [ACL2024 Findings] Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM☆57Updated last month
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆94Updated last year
- ☆44Updated 3 weeks ago
- ☆168Updated 9 months ago
- ☆421Updated 8 months ago