QuantaAlpha / GitTaskBenchLinks
Repo-level benchmark for real-world Code Agents: from repo understanding → env setup → incremental dev/bug-fixing → task delivery, with cost-aware α metric.
☆245Updated 4 months ago
Alternatives and similar repositories for GitTaskBench
Users that are interested in GitTaskBench are comparing it to the libraries listed below
Sorting:
- Marco Search Agent for Realistic and Challenging Agentic Search☆240Updated 3 months ago
- ☆360Updated 7 months ago
- Open-source framework for automatic video annotation.☆38Updated 8 months ago
- ☆210Updated last week
- ☆280Updated last month
- ☆114Updated 3 weeks ago
- Code for "FaithLens: Detecting and Explaining Faithfulness Hallucination"☆98Updated last month
- This repo collects research papers that use AI tools and are in the field of scientific research (including computer science, agronomy, c…☆98Updated 10 months ago
- DPO-Shift: Shifting the Distribution of Direct Preference Optimization☆59Updated 11 months ago
- [ICLR 2026] InfoMosaic-Bench: Evaluating Multi-Source Information Seeking in Tool-Augmented Agents☆128Updated this week
- Group Expectation Policy Optimization for Heterogeneous Reinforcement Learning☆167Updated last week
- We introduce temporal working memory (TWM), which aims to enhance the temporal modeling capabilities of Multimodal foundation models (MFM…☆311Updated 2 months ago
- MTLA: Multi-head Temporal Latent Attention☆760Updated 4 months ago
- ☆73Updated 2 months ago
- A database operations and data analysis AI agent☆430Updated 5 months ago
- ☆293Updated 7 months ago
- (EMNLP 2025 Findings) Source Evaluation scripts for Humanity's Last Code Exam☆95Updated 5 months ago
- A reading list for trustworthy audio large language models.☆113Updated 2 weeks ago
- [TMLR'25] The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning☆53Updated 9 months ago
- [ACL 2025] FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation☆62Updated 7 months ago
- [ICLR 2026] BIRD-INTERACT: Re-imagines Text-to-SQL evaluation via lens of dynamic interactions.☆477Updated 2 weeks ago
- Tokenize The Virtual Agents Onchain☆243Updated 8 months ago
- Dataset and evaluation code of ISDrama(ACM-MM 2025): Immersive Spatial Drama Generation through Multimodal Prompting☆236Updated 5 months ago
- [COLM 2025] Assessing Judging Bias in Large Reasoning Models: An Empirical Study https://openreview.net/pdf?id=SlRtFwBdzP☆163Updated 4 months ago
- A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.☆196Updated last year
- Official Code for MTSQL-R1: Towards Long-Horizon Multi-Turn Text-to-SQL via Agentic Training☆38Updated 3 months ago
- ☆138Updated 7 months ago
- Query-aware Token Selector (QTSplus), a lightweight yet powerful visual token selection module that serves as an information gate between…☆130Updated 2 months ago
- ☆71Updated 4 months ago
- Science-Star: A Platform for Building, Extending, and Experimenting with Scientific Agents.☆741Updated 3 months ago