alphadl / OOP-evalLinks
The first Object-Oriented Programming (OOP) Evaluaion Benchmark for LLMs
☆24Updated 10 months ago
Alternatives and similar repositories for OOP-eval
Users that are interested in OOP-eval are comparing it to the libraries listed below
Sorting:
- [ICLR 2022] Official repository for "Knowledge Removal in Sampling-based Bayesian Inference"☆18Updated 3 years ago
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆31Updated last year
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆64Updated last year
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆28Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆83Updated last year
- 🚀enhanced GRPO with more verifiable rewards and real-time evaluators☆37Updated 5 months ago
- [ACL'24] Can LLMs Speak For Diverse People? Tuning LLMs via Debate to Generate Controllable Controversial Statements☆23Updated last year
- ☆28Updated last year
- [ICML 2024] Code for the paper "Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases"☆39Updated last year
- ☆80Updated 8 months ago
- A Lightweight Visual Reasoning Benchmark for Evaluating Large Multimodal Models through Complex Diagrams in Coding Tasks☆13Updated 9 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆90Updated 2 years ago
- Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304☆13Updated 3 years ago
- [NAACL 2024] Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models☆86Updated last year
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- Pre-trained Language Model for Scientific Text☆46Updated last year
- Official implementation of Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs (ICLR 2024).☆43Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆64Updated 2 years ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆55Updated last year
- ☆54Updated last year
- Training and Benchmarking LLMs for Code Preference.☆37Updated last year
- [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…☆29Updated last year
- PASTA: Post-hoc Attention Steering for LLMs☆129Updated last year
- ☆28Updated last year
- FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion☆183Updated last week
- Repo for Llatrieval☆31Updated last year
- ☆17Updated last year
- ☆60Updated 10 months ago
- ☆103Updated last year