evalplus / repoqa
RepoQA: Evaluating Long-Context Code Understanding
☆103Updated 4 months ago
Alternatives and similar repositories for repoqa:
Users that are interested in repoqa are comparing it to the libraries listed below
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆131Updated 4 months ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆58Updated 5 months ago
- Training and Benchmarking LLMs for Code Preference.☆33Updated 3 months ago
- EvoEval: Evolving Coding Benchmarks via LLM☆66Updated 10 months ago
- ☆68Updated last month
- r2e: turn any github repository into a programming agent environment☆100Updated this week
- XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts☆30Updated 8 months ago
- ☆44Updated 9 months ago
- ☆22Updated 4 months ago
- Enhancing AI Software Engineering with Repository-level Code Graph☆136Updated last month
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆145Updated 6 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆131Updated 7 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 10 months ago
- ☆76Updated last week
- ☆59Updated 9 months ago
- ☆28Updated 3 months ago
- ☆68Updated last week
- ☆85Updated 7 months ago
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆63Updated 6 months ago
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆48Updated 4 months ago
- A Comprehensive Benchmark for Software Development.☆94Updated 9 months ago
- ☆30Updated 3 months ago
- CodeUltraFeedback: aligning large language models to coding preferences☆69Updated 8 months ago
- Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)☆51Updated 8 months ago
- ☆74Updated last year
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆295Updated last week