gersteinlab / ML-Bench
The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.09835)
☆286Updated 2 months ago
Alternatives and similar repositories for ML-Bench:
Users that are interested in ML-Bench are comparing it to the libraries listed below
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆167Updated 2 months ago
- ☆281Updated this week
- A curated list of resources on graph-based retrieval-augmented generation (GraphRAG) for customized large language models.☆300Updated this week
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆61Updated 3 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆151Updated last month
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆154Updated last month
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆172Updated 2 weeks ago
- Code Efficiency Benchmark☆69Updated 3 weeks ago
- Pytorch Library for Relational Table Learning with LLMs.☆275Updated this week
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆93Updated last year
- Multilingual Corpus of Web Fiction☆188Updated 7 months ago
- The official code for "Olympus: A Universal Task Router for Computer Vision Tasks"☆46Updated last month
- A curated list of awesome leaderboard-oriented resources for foundation models☆251Updated 3 weeks ago
- A Contamination-free Multi-task Language Understanding Benchmark☆113Updated 3 weeks ago
- ☆14Updated 2 years ago
- A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.☆196Updated 7 months ago
- One-stop data intelligence agent, providing insights from all mainstream data formats in a single dialogue box, including documents, data…☆373Updated 2 months ago
- Harnessing the Power of AI to Navigate the Information Age – Uncovering Truth, Promoting Transparency, and Championing Fact-Based Discour…☆151Updated last year
- ☆421Updated 5 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆165Updated 2 months ago
- ☆184Updated this week
- An ultra-lightweight agentic AI framework based on the ReAct paradigm.☆181Updated 2 weeks ago
- A Tiny structure of pytorch for learning;☆55Updated 6 months ago
- TxBKG - Knowledge Graph Generation for Any PDFs☆179Updated 2 months ago
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆193Updated 6 months ago
- Unified KV Cache Compression Methods for Auto-Regressive Models☆854Updated 3 weeks ago
- Mixed precision inference by Tensorrt-LLM☆76Updated 3 months ago
- A general AI agent framework that can be adapted to various tasks and environments.☆99Updated last week
- ☆167Updated 6 months ago