crux-eval / eval-arena
☆22Updated 3 months ago
Alternatives and similar repositories for eval-arena:
Users that are interested in eval-arena are comparing it to the libraries listed below
- Training and Benchmarking LLMs for Code Preference.☆32Updated 3 months ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆57Updated 4 months ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆46Updated last year
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 10 months ago
- XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts☆29Updated 7 months ago
- code for "Natural Language to Code Translation with Execution"☆40Updated 2 years ago
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆47Updated 3 months ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆77Updated 10 months ago
- ☆28Updated 3 months ago
- ☆43Updated 8 months ago
- ☆28Updated 3 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆83Updated last year
- ☆33Updated last year
- ☆53Updated last year
- ☆60Updated 9 months ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆77Updated 5 months ago
- Lightweight tool to identify Data Contamination in LLMs evaluation☆46Updated 11 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆59Updated 3 months ago
- Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups☆26Updated last month
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆62Updated 5 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆125Updated 4 months ago
- CodeUltraFeedback: aligning large language models to coding preferences☆68Updated 7 months ago
- Tasks for describing differences between text distributions.☆16Updated 6 months ago
- RepoQA: Evaluating Long-Context Code Understanding☆102Updated 3 months ago
- Scratchpad/Chain-of-Thought Prompts☆12Updated 2 years ago
- Evaluate the Quality of Critique☆35Updated 8 months ago
- ☆33Updated 10 months ago
- Long Context Extension and Generalization in LLMs☆48Updated 4 months ago
- ☆40Updated last week
- ☆39Updated 6 months ago