DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference code and tests) covering six domains (i.e., Computation, Basic, Network, Cryptography, Visualization, System).
☆14Dec 12, 2024Updated last year
Alternatives and similar repositories for DomainEval
Users that are interested in DomainEval are comparing it to the libraries listed below
Sorting:
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆12Oct 12, 2024Updated last year
- ☆16Nov 26, 2024Updated last year
- exploring whether LLMs perform case-based or rule-based reasoning☆30Mar 2, 2024Updated last year
- ☆12Jan 11, 2026Updated last month
- [CVPR2024] Learning from Synthetic Human Group Activities☆14Feb 24, 2025Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆12Jul 14, 2025Updated 7 months ago
- Maze generation and path-finding algorithm visualiser using React.js.☆10Jun 27, 2022Updated 3 years ago
- A Swedish Natural Language Understanding Benchmark☆11Dec 12, 2025Updated 2 months ago
- The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈☆16Updated this week
- Code for our project CROWN (Conversational Passage Ranking by Reasoning over Word Networks)☆10Jan 11, 2024Updated 2 years ago
- ☆14Jun 24, 2024Updated last year
- LLM red teaming datasets from the paper 'Student-Teacher Prompting for Red Teaming to Improve Guardrails' for the ART of Safety Workshop …☆22Oct 12, 2023Updated 2 years ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- Dataset for AAAI paper "Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts"☆11Nov 18, 2022Updated 3 years ago
- ☆11Jan 3, 2024Updated 2 years ago
- 中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级☆10May 6, 2024Updated last year
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- ☆11Nov 5, 2024Updated last year
- Survey of available speech datasets for Polish ASR development☆17Jan 1, 2025Updated last year
- ☆12Nov 5, 2024Updated last year
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- Shaping Language Models with Cognitive Insights☆15Feb 29, 2024Updated 2 years ago
- Offical implementation of our paper "Exploring the Potential of Diffusion Large Language Models in Code Generation".☆20Oct 29, 2025Updated 4 months ago
- Code and Data for GlitchBench☆13Feb 27, 2024Updated 2 years ago
- Website for release of TellMeWhy dataset for why question answering☆14Nov 11, 2022Updated 3 years ago
- ☆12Mar 5, 2025Updated 11 months ago
- ☆11Oct 15, 2022Updated 3 years ago
- benchmarks for evaluating MT models☆11Jun 26, 2024Updated last year
- Chinese Generation Evaluation☆13Aug 14, 2023Updated 2 years ago
- Automated Pyramid Summarization Evaluation☆12Jun 2, 2024Updated last year
- An LSTM model implemented by PyTorch to perform sentiment classification on the Stanford Sentiment Treebank (SST-5) dataset.☆11Sep 13, 2022Updated 3 years ago
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation☆14Aug 19, 2025Updated 6 months ago
- Xlore2.0 Code[BaiduExtractor, HudongExtractor, WikiExtractor, XloreData, XloreWeb]☆12Apr 5, 2017Updated 8 years ago
- Official Code Repository for Diagnosing Colorectal Polyps in the Wild with Capsule Networks☆16Nov 22, 2022Updated 3 years ago
- Demo scripts for HPS Dataset (http://virtualhumans.mpi-inf.mpg.de/hps/)☆11Mar 10, 2025Updated 11 months ago
- ☆10Feb 3, 2025Updated last year
- ☆12Feb 26, 2025Updated last year
- CVPR(Highlight) Decoupled Distillation to Erase: A General Unlearning Method for Any Class-centric Tasks☆18Jul 22, 2025Updated 7 months ago
- ☆14Jul 27, 2020Updated 5 years ago