gersteinlab / ML-Bench
The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.09835)
☆287Updated 3 months ago
Alternatives and similar repositories for ML-Bench:
Users that are interested in ML-Bench are comparing it to the libraries listed below
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆173Updated 3 months ago
- Code Efficiency Benchmark☆71Updated last month
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆158Updated 2 months ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆62Updated 4 months ago
- JittorGeometric is a Jittor-based graph machine learning library.☆149Updated last month
- Mulberry, an o1-like Reasoning and Reflection MLLM Implemented via Collective MCTS☆779Updated 2 weeks ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆153Updated 2 months ago
- [ACL2024 Findings] Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM☆56Updated last month
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆181Updated last week
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆93Updated last year
- A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.☆197Updated 8 months ago
- Pytorch Library for Relational Table Learning with LLMs.☆322Updated this week
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 4 months ago
- The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models☆545Updated 3 weeks ago
- [CVPR 2025] The official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆48Updated this week
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆193Updated 7 months ago
- Multilingual Corpus of Web Fiction☆190Updated 8 months ago
- One-stop data intelligence agent, providing insights from all mainstream data formats in a single dialogue box, including documents, data…☆400Updated 3 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆128Updated last month
- [ICLR 2025] Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models☆31Updated last month
- A general AI agent framework that can be adapted to various tasks and environments.☆99Updated last month
- ☆14Updated 2 years ago
- TxBKG - Knowledge Graph Generation for Any PDFs☆181Updated 3 months ago
- ☆421Updated 6 months ago