HumanEvalComm: Evaluating Communication Skill of Code LLM and LLM Agent
☆13Feb 8, 2026Updated 8 months ago
Alternatives and similar repositories for human-eval-comm
Users that are interested in human-eval-comm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Replication package of the paper "Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models" (T…☆23Oct 14, 2024Updated 2 years ago
- Free, open-source property manager for short-term rental hosts. Sync Airbnb + Booking.com calendars, automate cleaning schedules, extract…☆29Updated this week
- Code and dataset for EMNLP 2022 Findings paper "Benchmarking Language Models for Code Syntax Understanding"☆16Oct 24, 2022Updated 4 years ago
- Finetune Llama 3.2 1B model on the python code dataset☆12Feb 18, 2025Updated last year
- DocChecker: Bootstrapping Code-Text Pretrained Language Model to Detect Inconsistency Between Code and Comment☆15Jan 23, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ICLR 2024] Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain☆12Nov 24, 2025Updated 11 months ago
- Official implementation of **LLMs Caught in the Crossfire: Malware Requests and Jailbreak Challenges (ACL 2025)**☆12May 25, 2025Updated last year
- [ASE2024] Mutual Learning-Based Framework for Enhancing Robustness of Code Models via Adversarial Training☆11Sep 13, 2024Updated 2 years ago
- Implementation of M2PT in PyTorch from the paper: "Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities"☆14Mar 11, 2024Updated 2 years ago
- Probing pre-trained source code models☆16Apr 27, 2022Updated 4 years ago
- CI for your coding-agent setup (CLAUDE.md, skills, hooks): pinned baselines, a canary on every Claude Code release, model and version mat…☆33Updated this week
- InterruptBench: Evaluating LLM Agents Under User Interruptions in Long-Horizon Web Tasks☆16Jul 9, 2026Updated 3 months ago
- Data and code for paper "Language Models Encode the Value of Numbers Linearly"☆10Nov 14, 2024Updated last year
- Data visualization code generation benchmark: Evaluates LLMs' ability to generate visualization code from DataFrame descriptions.☆13Nov 28, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Packs text files into small images that an AI model reads for about half the input tokens. Includes a Claude Code plugin, a right-click t…☆32Updated this week
- SafeWorld: Geo-Diverse Safety Alignment (NeurIPS 2024)☆10Dec 10, 2024Updated last year
- Automatically Update LLM Papers Daily using Github Actions. Ref: https://github.com/Vincentqyw/cv-arxiv-daily☆11Updated this week
- AI Multi-Agent Novel Writing Framework Based on OpenAI-Agent-SDK☆13Mar 13, 2025Updated last year
- Offical implementation of our paper "FeatBench: Towards More Realistic Evaluation of Feature-level Code Generation".☆16Mar 13, 2026Updated 7 months ago
- On the Robustness of GUI Grounding Models Against Image Attacks☆12Apr 8, 2025Updated last year
- Software Engineering, BUAA 课程资源共享平台☆11Apr 24, 2018Updated 8 years ago
- A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languages☆20Jun 11, 2026Updated 4 months ago
- Official repository for "CompilerDream: Learning a Compiler World Model for General Code Optimization" (KDD 2025), https://arxiv.org/abs/…☆12May 30, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆11Nov 10, 2020Updated 5 years ago
- Is Neuron Coverage a Meaningful Measure for Testing Deep Neural Networks? (FSE 2020)☆10Sep 23, 2021Updated 5 years ago
- Code for ICML2020 "Sequence Generation with Mixed Representations"☆12Jun 27, 2020Updated 6 years ago
- 🔮 Alexa integration with Google Assistant☆10Nov 30, 2018Updated 7 years ago
- ☆13May 30, 2025Updated last year
- MICRO 2023 Evaluation Artifact for TeAAL☆13Oct 26, 2023Updated 3 years ago
- ☆10Jun 11, 2019Updated 7 years ago
- ☆12Dec 10, 2025Updated 10 months ago
- Convert pretrained RoBerta models to various long-document transformer models☆11Apr 5, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Gephi tutorials for data visualisation lecture. A Network Tour of Data Science 2019 Fall semester☆12Apr 11, 2021Updated 5 years ago
- You've been pinched. Now get unpinched. Find out if PinchTab is running on your host before someone else does.☆13Apr 22, 2026Updated 6 months ago
- Web Interface for gaze recording: CVPR 2018☆10Jul 10, 2018Updated 8 years ago
- Portable EAP Google Authenticator ESP32 hardware.☆30Apr 17, 2026Updated 6 months ago
- ☆16May 24, 2025Updated last year
- generative language model training on top of the JAX and Huggingface 🤗☆10May 11, 2022Updated 4 years ago
- A collection of publications that works on code models but beyond focusing on the accuracies.☆12Jun 30, 2023Updated 3 years ago