The data and code for paper: "SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints"
☆18Nov 17, 2025Updated 8 months ago
Alternatives and similar repositories for SOPBench
Users that are interested in SOPBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Dataset and Official Implementation for <Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understandi…☆19Aug 7, 2024Updated 2 years ago
- ☆15Jul 24, 2024Updated 2 years ago
- [ICME 2019] Source code and datasets for "Semi-supervised Compatibility Learning Across Categories for Clothing Matching"☆11Apr 26, 2024Updated 2 years ago
- This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…☆22Nov 16, 2023Updated 2 years ago
- On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (Findings of EMNLP 2021))☆13Nov 21, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official code for the publication "Large Language Models as Zero-shot Dialogue State Tracker through Function Calling" https//arxiv.org/a…☆71Aug 14, 2024Updated last year
- [CVPR 2025🔥] Official codebase for "Global-Local Tree Search in VLMs for 3D Indoor Scene Generation" and our arxiv 2026 extension☆23Jun 5, 2026Updated 2 months ago
- Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context, AAAI 2020.☆43Aug 20, 2024Updated last year
- Code for "A Multi-Task BERT Model for Schema-Guided Dialogue State Tracking"☆14May 26, 2023Updated 3 years ago
- Building self-refined guardrails via DSPy☆14Jun 25, 2026Updated last month
- This is the repository for EMNLP 2022 paper "Efficient Zero-shot Event Extraction with Context-Definition Alignment"☆11Dec 27, 2024Updated last year
- Code and datasets of TPAMI 2022 paper《OPOM: Customized Invisible Cloak towards Face Privacy Protection》☆23May 13, 2022Updated 4 years ago
- ☆14Aug 21, 2025Updated 11 months ago
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆20Nov 16, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Companion code to https://arxiv.org/abs/2402.15491☆22Sep 18, 2025Updated 10 months ago
- 查找漏网之鱼：根据 对照名单查找缺漏的名字☆10Dec 22, 2025Updated 7 months ago
- Official implementation of the ICCV2023 paper: Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregatio…☆28Aug 17, 2023Updated 2 years ago
- ☆21Mar 19, 2024Updated 2 years ago
- OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language World Models☆21Apr 14, 2026Updated 3 months ago
- Builds a WMT18-like corpus for word-level QE with annotations in the source and target words.☆10Sep 19, 2022Updated 3 years ago
- A curated collection of projects, benchmarks, and research papers focused on reproducing and advancing the DeepSeek R1 framework.☆15Mar 19, 2025Updated last year
- ☆42Mar 24, 2026Updated 4 months ago
- ☆18Jul 25, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆24Jul 2, 2025Updated last year
- A toolkit for testing and improving named entity recognition [ESEC/FSE'23]☆11Aug 31, 2023Updated 2 years ago
- Whisper to Normal Speech Conversion with SC-MelGAN and SC-VQ-VAE☆15Dec 3, 2022Updated 3 years ago
- The official implementation of the paper "Self-Updatable Large Language Models by Integrating Context into Model Parameters"☆15May 18, 2025Updated last year
- Albert for Conversational Question Answering Challenge☆21Jun 12, 2023Updated 3 years ago
- Data for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder"☆20Oct 26, 2023Updated 2 years ago
- r4c☆14Mar 2, 2021Updated 5 years ago
- We design models that generate conversational responses for factual questions using expert answer phrases from Question Answering systems…☆21Jul 2, 2020Updated 6 years ago
- Python probabilistic PCA (PPCA) implementation.☆13Nov 28, 2018Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Automatically switch between podcast camera views depending on who's talking☆10Aug 22, 2019Updated 6 years ago
- AAAI 2021: "UBAR: Towards Fully End-to-End Task-Oriented Dialog System with GPT-2"☆97Mar 10, 2021Updated 5 years ago
- A conversational bookkeeping skill for Claude AI — track expenses, invoices, subscriptions, and budgets through natural language. Dashboa…☆17Mar 22, 2026Updated 4 months ago
- Code to generate figures of paper "When do spectral gradient updates help in deep learning?"☆16Dec 3, 2025Updated 8 months ago
- Code and dataset for the paper: "Can Editing LLMs Inject Harm?" [AAAI'26]☆21Dec 26, 2025Updated 7 months ago
- Code and data for COLING2024 paper "Characteristic AI Agents via Large Language Models".☆25Nov 29, 2024Updated last year
- Making code edting up to 7.7x faster using multi-layer speculation☆23Feb 20, 2025Updated last year