BigOBench assesses the capacity of Large Language Models (LLMs) to comprehend time-space computational complexity of input or generated code.
☆43Apr 15, 2025Updated last year
Alternatives and similar repositories for BigOBench
Users that are interested in BigOBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dataset and evaluation benchmark for Privacy Leakage Evaluation of Autonomous Web Agents☆45Apr 18, 2026Updated 3 months ago
- EgoToM is an egocentric theory-of-mind benchmark built on Ego4D videos, containing multi-choice questions that evaluate multimodal large …☆16Apr 1, 2025Updated last year
- This repository contains code and datasets for our paper on the effects of document multiplicity while the context size is fixed in Retri…☆18Mar 13, 2025Updated last year
- Code for the paper "Watermarking Makes Language Models Radioactive"☆26Oct 25, 2024Updated last year
- Official PyTorch codebase for the Modeling Caption Diversity in ContrastiveVision-Language Pretraining paper.☆19Mar 28, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)☆34Mar 24, 2025Updated last year
- Generating Adversarial Examples for Holding Robustness of Source Code Processing Models☆17Dec 2, 2021Updated 4 years ago
- Patch management tool for git submodules☆17Jul 25, 2025Updated last year
- ☆55May 3, 2026Updated 3 months ago
- Image Search Engine with HuggingFace Sentence Transformer☆12Aug 31, 2023Updated 2 years ago
- AI Agent leveraging symbolic reasoning and other auxiliary tools to boost its capabilities on various logic and reasoning benchmarks. Thi…☆47Mar 31, 2026Updated 4 months ago
- CHAI is a library for dynamic pruning of attention heads for efficient LLM inference.☆24Dec 11, 2024Updated last year
- IBM Quantum Challenge Fall 2023☆10May 23, 2023Updated 3 years ago
- Demo web client for using matrix-files-sdk☆17Jan 31, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆24May 7, 2026Updated 3 months ago
- Official Repo for DAC-RL: Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability☆16Feb 26, 2026Updated 5 months ago
- Building reliable Retrieval Augmented Generation(RAG) AI Architecture☆13Jul 30, 2024Updated 2 years ago
- ☆44Oct 28, 2025Updated 9 months ago
- ☆14Jan 22, 2025Updated last year
- LLM-based mutation testing☆17Feb 3, 2025Updated last year
- ☆15Updated this week
- ☆10Nov 16, 2023Updated 2 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Detachable, Dynamic combination, cloud native, modern DB infrastructure☆12Sep 17, 2024Updated last year
- ☆13Sep 12, 2024Updated last year
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated 10 months ago
- GrapheneOS Mastodon server☆19Aug 4, 2026Updated last week
- Your finetuned model's back to its original safety standards faster than you can say "SafetyLock"!☆11Oct 16, 2024Updated last year
- A toolkit for testing machine translation [ICSE'20, '21, ESEC/FSE'20]☆33Nov 15, 2021Updated 4 years ago
- This repository contains data, code and models for contextual noncompliance.☆26Jul 18, 2024Updated 2 years ago
- This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs☆44Aug 14, 2024Updated 2 years ago
- The official repository TimeAudio, a comprehensive framework that incorporates fine-grained acoustic cues into LALMs with enhanced module…☆31Nov 18, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'☆27May 16, 2025Updated last year
- VeriPy is a python based Verilog/Systemverilog automation tool. It automates ports/wire/reg/logic declarations, sub-module Instantiation,…☆38Jun 16, 2026Updated last month
- Please go to https://github.com/facebookresearch/stable_signature☆14Jul 26, 2023Updated 3 years ago
- [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆15Jun 21, 2024Updated 2 years ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆72May 22, 2025Updated last year
- A toolkit for testing and improving named entity recognition [ESEC/FSE'23]☆11Aug 31, 2023Updated 2 years ago
- Efficient Hyper-parameter Tuning at Scale (VLDB'22)☆10Dec 1, 2021Updated 4 years ago