WeixiangYAN / CodeScope
[ACL 2024] CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation
☆97Updated 5 months ago
Alternatives and similar repositories for CodeScope:
Users that are interested in CodeScope are comparing it to the libraries listed below
- [EMNLP 2023] CodeTransOcean: A Comprehensive Multilingual Benchmark for Code Translation☆50Updated last year
- [NeurIPS 2024] EffiBench: Benchmarking the Efficiency of Automatically Generated Code☆47Updated last month
- This includes the original implementation of CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control.☆56Updated 3 months ago
- Source code for "CoEdPilot: Recommending Code Edits with Learned Prior Edit Relevance, Project-wise Awareness, and Interactive Nature"☆97Updated 2 weeks ago
- Interaction2Code: How Far Are We From Automatic Interactive Webpage Generation?☆27Updated 2 months ago
- ☆46Updated 6 months ago
- A Unified Intermediate Representation for Graph Query Languages☆61Updated 2 years ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆48Updated 2 months ago
- This repo contains my customised style python based plots for NLP papers, and includes my reproduction for my favourite papers' plots☆36Updated 10 months ago
- LLM Benchmark for Code☆31Updated 5 months ago
- Grimoire is All You Need for Enhancing Large Language Models☆109Updated 10 months ago
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆93Updated last year
- A Comprehensive Benchmark for Code Information Retrieval.☆56Updated last month
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆166Updated 2 months ago
- This is the official code repository of MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tas…☆52Updated 4 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆149Updated last month
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response☆37Updated 3 weeks ago
- Code of Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Ne…☆24Updated 10 months ago
- Empower Your Model with Longer and Better Context Comprehention☆40Updated last year
- GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned Experts (NeurIPS 2024)☆21Updated 3 months ago
- [arXiv 2024] An official source code for paper "FlipAttack: Jailbreak LLMs via Flipping".☆86Updated 2 months ago
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆44Updated last year
- [NeurIPS'24] Knowledge Graph Fine-Tuning with Open-World Knowledge☆89Updated 3 months ago
- A Graph Query Language Transpiler☆32Updated 6 months ago
- [ACL 24 main] Large Language Models Can Learn Temporal Reasoning☆38Updated last month
- Code for ACL 2024 long paper: Are AI-Generated Text Detectors Robust to Adversarial Perturbations?☆23Updated 6 months ago
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆159Updated 2 months ago
- ☆29Updated 4 months ago
- ☆43Updated 3 months ago
- A curated list of resources on graph-based retrieval-augmented generation (GraphRAG) for customized large language models.☆55Updated this week