mahimanzum / FixEval
View external linksLinks

We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of execution based evaluation compared to suboptimal match based evaluation metrics like BLEU, CodeBLEU, Syntax Match, Exact Match etc.
26Aug 31, 2022Updated 3 years ago

Alternatives and similar repositories for FixEval

Users that are interested in FixEval are comparing it to the libraries listed below

Sorting:

Are these results useful?