infi-coder / infibench-evaluator
The evaluation framework for the InfiCoder-Eval benchmark.
☆19Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for infibench-evaluator
- ☆55Updated 6 months ago
- ☆21Updated 3 weeks ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆44Updated 11 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 10 months ago
- RepoQA: Evaluating Long-Context Code Understanding☆100Updated 3 weeks ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 7 months ago
- Training and Benchmarking LLMs for Code Preference.☆25Updated last week
- [EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.☆69Updated 8 months ago
- ☆75Updated last year
- CodeUltraFeedback: aligning large language models to coding preferences☆65Updated 5 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆115Updated last month
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆30Updated 9 months ago
- r2e: turn any github repository into a programming agent environment☆89Updated 3 weeks ago
- Benchmarking Agentic Workflow Generation☆30Updated 3 weeks ago
- ☆27Updated this week
- ☆28Updated 5 months ago
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆23Updated last month
- This is the implementation for the paper "LARGE LANGUAGE MODEL CASCADES WITH MIX- TURE OF THOUGHT REPRESENTATIONS FOR COST- EFFICIENT REA…☆18Updated 5 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆79Updated last year
- ☆55Updated 2 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆41Updated 9 months ago
- Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆39Updated last month
- ☆46Updated 2 weeks ago
- XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts☆27Updated 4 months ago
- ☆43Updated 10 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated 10 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆41Updated last month
- ☆33Updated last month
- ☆39Updated 5 months ago
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆56Updated 2 months ago