The evaluation framework for the InfiCoder-Eval benchmark.
☆21Jul 22, 2024Updated 2 years ago
Alternatives and similar repositories for infibench-evaluator
Users that are interested in infibench-evaluator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Oct 18, 2022Updated 4 years ago
- ☆14May 16, 2024Updated 2 years ago
- The Infibench variant of bigcode-evaluation-harness --- a framework for the evaluation of autoregressive code generation language models.☆14Oct 19, 2024Updated 2 years ago
- [CCS 2021] TSS: Transformation-specific smoothing for robustness certification☆26Oct 3, 2023Updated 3 years ago
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Dynamic config system based on python classes☆12Jan 27, 2023Updated 3 years ago
- The code accompanying paper: Nonlinear Gradient Estimation for Query Efficient Blackbox Attack☆10Feb 22, 2021Updated 5 years ago
- The Charon tool for analyzing neural network robustness☆13Mar 19, 2020Updated 6 years ago
- SQL and Bash scripts to import the offical Stack Overflow data dump and the SOTorrent data set, to retrieve Stack Overflow references fro…☆15Sep 14, 2025Updated last year
- ☆10Jul 31, 2025Updated last year
- ☆16Jul 29, 2025Updated last year
- cheatbench.ai☆18Updated this week
- ☆26Aug 23, 2024Updated 2 years ago
- Raspberry Pi Zero Emulator☆13Jun 18, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Nov 26, 2020Updated 5 years ago
- A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.☆19Feb 6, 2025Updated last year
- ☆10Apr 8, 2018Updated 8 years ago
- ☆16Nov 26, 2024Updated last year
- The official repo for GCP-CROWN paper☆13Sep 26, 2022Updated 4 years ago
- A simple OS X app to remind the user to take breaks during work.☆20Mar 11, 2015Updated 11 years ago
- Variational Autoencoder-Generative Adversarial Network (VAE-GAN) to hide data inside images☆12Nov 9, 2019Updated 6 years ago
- GAN based 3D Object Reconstruction in Point Cloud // 基于点云生成对抗网络的三维重建研究☆19Jun 25, 2018Updated 8 years ago
- ☆13Feb 14, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Extracts static code features from opencl kernels to be used for machine learning.☆10Apr 30, 2021Updated 5 years ago
- Books on programming and computer science☆15Jan 23, 2014Updated 12 years ago
- ☆15Nov 12, 2025Updated 11 months ago
- ☆16Jul 9, 2025Updated last year
- The official codes for our paper at COLING 2022: Semantic-Preserving Adversarial Code Comprehension☆12Oct 23, 2022Updated 4 years ago
- An Empirical Comparison of Unsupervised Constituency Parsing Methods☆14Aug 15, 2021Updated 5 years ago
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆20Nov 16, 2022Updated 3 years ago
- Implementation of the paper "Direct Optimization through argmax for discrete Variational Auto-Encoder"☆15Sep 15, 2020Updated 6 years ago
- Code and data for "Impact of Evaluation Methodologies on Code Summarization" in ACL 2022.☆10Sep 6, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆33Sep 9, 2016Updated 10 years ago
- Accompanying code for the ProteinGLUE method☆13Apr 12, 2022Updated 4 years ago
- Keeps track of popular provable training and verification approaches towards robust neural networks, including leaderboards on popular da…☆20Jun 12, 2024Updated 2 years ago
- ☆20May 24, 2024Updated 2 years ago
- The raw statistics of the paper "Security Debt in LLM Agent Applications: A Measurement Study of Vulnerabilities and Mitigation Trade-off…☆15Sep 2, 2025Updated last year
- [MICCAI2022] Estimating Model Performance under Domain Shifts with Class-Specific Confidence Scores.☆12Jun 7, 2024Updated 2 years ago
- github for the paper "Have Seen Me Before? Automating Dataset Updates Towards Reliable and Timely Evaluation"☆10Oct 20, 2024Updated 2 years ago