[COLING25] CodeJudge Eval: Can Large Language Models be Good Judges in Code Understanding?
☆12Dec 3, 2024Updated last year
Alternatives and similar repositories for CodeJudge-Eval
Users that are interested in CodeJudge-Eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [EMNLP 2024] Multi-modal reasoning problems via code generation.☆28Apr 14, 2026Updated 7 months ago
- ☆24Aug 23, 2024Updated 2 years ago
- A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed☆11Apr 14, 2023Updated 3 years ago
- pytorch版损失函数,改写自科学空间文章,【通过互信息思想来缓解类别不平衡问题】、【将“softmax+交叉熵”推广到多标签分类问题】☆12Aug 22, 2021Updated 5 years ago
- Data and code for "Chain-of-Thought in Neural Code Generation: From and For Lightweight Language Models", which accepted in TSE.☆16Jul 3, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [EMNLP 2023] CodeTransOcean: A Comprehensive Multilingual Benchmark for Code Translation☆58Nov 16, 2023Updated 3 years ago
- Code of the COLING22 paper "uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers"☆19Aug 17, 2022Updated 4 years ago
- Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking☆13Feb 5, 2023Updated 3 years ago
- Contests based Dataset for Code Generation☆13Dec 11, 2022Updated 3 years ago
- This is the project repository of our ASE22 paper: Natural Test Generation for Precise Testing of Question Answering Software☆14Dec 1, 2022Updated 3 years ago
- The CodeInsight dataset is designed for code generation tasks, providing developers with expert-curated examples that bridge the gap betw…☆14Oct 22, 2024Updated 2 years ago
- ☆13Oct 17, 2024Updated 2 years ago
- Replication package for EMNLP2022 paper- RACE: Retrieval-Augmented Commit Message Generation☆19Oct 21, 2022Updated 4 years ago
- Replication package for ISSTA2023 paper - Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond☆23Apr 9, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆13Oct 9, 2025Updated last year
- We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of e…☆26Aug 31, 2022Updated 4 years ago
- This repository contains the data and code for the paper "Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Pr…☆26Jun 27, 2022Updated 4 years ago
- LLM inference with HuggingFace (experimental)☆11Feb 6, 2025Updated last year
- Code for our EMNLP 2023 paper - Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Mode…☆15May 5, 2024Updated 2 years ago
- Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"☆48Jun 2, 2026Updated 5 months ago
- [NeurIPS 2024] Self-Optimization Improves the Efficiency of Code Generation☆15May 10, 2025Updated last year
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆16Oct 12, 2024Updated 2 years ago
- HKBU PhD/MPhil thesis template as well as key steps for submission☆38Sep 27, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A minimal LLM sales agent framework for sales agent fast deployment and benchmark. Support OpenAI models, Claude, HuggingFace models, Gem…☆20Sep 6, 2024Updated 2 years ago
- ☆13Jul 10, 2024Updated 2 years ago
- Paper list for "From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms".☆61Apr 13, 2026Updated 7 months ago
- Code for the AAAI 2023 paper "CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models☆34Apr 18, 2023Updated 3 years ago
- A textual TUI for Prodigy☆16Jun 8, 2023Updated 3 years ago
- ☆12Jun 24, 2017Updated 9 years ago
- ☆10Apr 15, 2023Updated 3 years ago
- IEEE XPLORE等文献网站的爬虫工具/Crawler for Paper Website like IEEE XPLORE☆43Jul 17, 2025Updated last year
- ☆14Dec 24, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆10Jan 7, 2019Updated 7 years ago
- ☆16Jan 3, 2023Updated 3 years ago
- GaitParsing: Human Semantic Parsing for Gait Recognition (IEEE TMM)☆13May 20, 2024Updated 2 years ago
- This is the project repository of our ESEC/FSE 2021 paper: A Comprehensive Study of Deep Learning Compiler Bugs.☆24Aug 15, 2023Updated 3 years ago
- FastSAG: Towards Fast Non-Autoregressive Singing Accompaniment Generation☆30Dec 19, 2024Updated last year
- Implementations of Influential Recommender System☆13Oct 29, 2024Updated 2 years ago
- DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference …☆13Dec 12, 2024Updated last year
Are these results useful?