MCEVAL / McEvalLinks
☆45Updated last year
Alternatives and similar repositories for McEval
Users that are interested in McEval are comparing it to the libraries listed below
Sorting:
- NaturalCodeBench (Findings of ACL 2024)☆68Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆87Updated last year
- ☆54Updated last year
- ☆33Updated 3 months ago
- Heuristic filtering framework for RefineCode☆82Updated 9 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆161Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆164Updated 3 months ago
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆84Updated last year
- Collection of papers for scalable automated alignment.☆94Updated last year
- A Comprehensive Benchmark for Software Development.☆122Updated last year
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆64Updated last year
- Reproducing R1 for Code with Reliable Rewards☆277Updated 7 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆109Updated 6 months ago
- LeetCode Training and Evaluation Dataset☆43Updated 7 months ago
- CFBench: A Comprehensive Constraints-Following Benchmark for LLMs☆44Updated last year
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆73Updated last year
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆61Updated last year
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆134Updated last year
- 代码大模型 预训练&微调&DPO 数据处理 业界处理pipeline sota☆46Updated last year
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆117Updated 6 months ago
- SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution☆101Updated 2 months ago
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆181Updated 9 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆97Updated 9 months ago
- ☆108Updated 5 months ago
- [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization☆40Updated 9 months ago
- Generate the WizardCoder Instruct from the CodeAlpaca☆21Updated 2 years ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆253Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆182Updated last year
- Baselines for all tasks from Long Code Arena benchmarks 🏟️☆38Updated 8 months ago
- ☆15Updated last year