DependEval: a hierarchical benchmark for evaluating LLMs on repository-level code understanding across 8 programming languages.
☆16Jul 28, 2025Updated last year
Alternatives and similar repositories for DependEval
Users that are interested in DependEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICSE '25] LLM Based Input Space Partitioning Testing for Library APIs☆14Jul 27, 2025Updated last year
- ☆14Sep 12, 2024Updated 2 years ago
- This is a JLU-SNL-COMPILER project☆13Oct 6, 2023Updated 2 years ago
- Simple example of how to write an Implicit GEMM Convolution in CUDA using the tensor core WMMA API and bindings for PyTorch.☆19Jun 29, 2023Updated 3 years ago
- ☆23Mar 28, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code and resource of "FinEntity: Entity-level Sentiment Classification for Financial Texts" (EMNLP 2023)☆20Jan 30, 2024Updated 2 years ago
- Dataset of Codex generated tests for the CodaMosa project☆19Jun 2, 2023Updated 3 years ago
- Codebase for EMNLP 2025 Findings paper "Text or Pixels? Evaluating Efficiency and Understanding of LLMs with Visual Text Inputs"☆19Nov 14, 2025Updated 10 months ago
- ☆16Oct 15, 2025Updated 11 months ago
- Code to reproduce results of our experiments using LoRe☆18Jun 10, 2026Updated 3 months ago
- ☆32Aug 24, 2022Updated 4 years ago
- CONCOCTION is an automated machine learning-based vulnerability detection framework that combines static source code information and dyna…☆28Aug 18, 2024Updated 2 years ago
- This is an evaluation set for the problem of directed/targeted test input generation. We use it to benchmark the ability of Large Languag…☆34Mar 11, 2025Updated last year
- ☆37Jan 27, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2025] The implementation of paper "The Emergence of Abstract Thought in Large Language Models Beyond Any Language"☆20Jun 9, 2025Updated last year
- ☆15Oct 17, 2023Updated 2 years ago
- SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution [ICSE 2026]☆34Nov 11, 2025Updated 10 months ago
- TestGenEval A Real World Unit Test Generation and Test Completion Benchmark☆34Mar 12, 2026Updated 6 months ago
- This repository contains the code for applying One-Token Approximation to a pretrained language model using subword-level tokenization.☆12May 7, 2020Updated 6 years ago
- Defects4C☆24May 2, 2026Updated 4 months ago
- This repository contains the WordNet Language Model Probing (WNLaMPro) dataset introduced in "Rare Words: A Major Problem for Contextuali…☆14Feb 2, 2020Updated 6 years ago
- ☆12Mar 25, 2022Updated 4 years ago
- CodeOCR: On the Effectiveness of Vision Language Models in Code Understanding [ISSTA 2026]☆32Feb 2, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Oct 17, 2020Updated 5 years ago
- ☆13Jul 6, 2021Updated 5 years ago
- Cottontail: A LLM-Driven Concolic Execution Engine (Accepted by IEEE S&P'26)☆48Dec 4, 2025Updated 9 months ago
- a small, non-commercial, fair-use subset of the Penn-Treebank, in JSON.☆17Apr 10, 2018Updated 8 years ago
- This is the tool released in ICSE 2022 paper "Static Inference Meets Deep Learning: A Hybrid Type Inference Approach for Python"☆45Oct 19, 2023Updated 2 years ago
- Comparison between Sarsa and Q-Learning algorithms on risk handling☆17Jul 10, 2017Updated 9 years ago
- Code and data for "KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark" (LREC-COLING…☆18Apr 15, 2025Updated last year
- ☆30Jun 2, 2026Updated 3 months ago
- Data and preprocessing scripts for SemEval 2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding☆16Feb 3, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Weakly Supervised Temporal Anomaly Segmentation☆16Nov 24, 2021Updated 4 years ago
- ☆14May 7, 2019Updated 7 years ago
- find python module imports☆25Feb 7, 2026Updated 7 months ago
- LeetCode Training and Evaluation Dataset☆55Apr 22, 2025Updated last year
- MutAP: A prompt_based learning technique to automatically generate test cases with Large Language Model☆59Mar 7, 2025Updated last year
- ☆20Oct 22, 2021Updated 4 years ago
- List of research papers of ICSE, FSE, ASE, and ISSTA since 2020.☆38Dec 29, 2025Updated 8 months ago