The data and code for paper: "SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints"
☆19Sep 13, 2026Updated last week
Alternatives and similar repositories for SOPBench
Users that are interested in SOPBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jul 24, 2024Updated 2 years ago
- [ICME 2019] Source code and datasets for "Semi-supervised Compatibility Learning Across Categories for Clothing Matching"☆11Apr 26, 2024Updated 2 years ago
- This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…☆23Nov 16, 2023Updated 2 years ago
- On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (Findings of EMNLP 2021))☆13Nov 21, 2021Updated 4 years ago
- Distributed lbfgs on Apache Spark☆10Sep 25, 2020Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context, AAAI 2020.☆43Aug 20, 2024Updated 2 years ago
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆20Aug 7, 2025Updated last year
- Building self-refined guardrails via DSPy☆15Jun 25, 2026Updated 2 months ago
- This is the repository for EMNLP 2022 paper "Efficient Zero-shot Event Extraction with Context-Definition Alignment"☆11Dec 27, 2024Updated last year
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆20Nov 16, 2022Updated 3 years ago
- Graph partitioning for distributed GNN training☆13Mar 26, 2023Updated 3 years ago
- Companion code to https://arxiv.org/abs/2402.15491☆22Sep 18, 2025Updated last year
- Mustache in Python☆18Mar 18, 2025Updated last year
- An easy tool to extract slides from presentations ( lectures 😉 )☆14Dec 10, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Official implementation of the ICCV2023 paper: Enhancing Generalization of Universal Adversarial Perturbation through Gradient Aggregatio…☆28Aug 17, 2023Updated 3 years ago
- ☆21Mar 19, 2024Updated 2 years ago
- OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language World Models☆22Apr 14, 2026Updated 5 months ago
- Toolbox for IBP Coupled SPCM-CRP Hidden Markov Model. Also contains code for EM-based HMM learning and inference for Bayesian non-paramet…☆14Mar 21, 2019Updated 7 years ago
- Implementation of MetaVQA.☆12Jul 3, 2021Updated 5 years ago
- Builds a WMT18-like corpus for word-level QE with annotations in the source and target words.☆10Sep 19, 2022Updated 4 years ago
- A curated collection of projects, benchmarks, and research papers focused on reproducing and advancing the DeepSeek R1 framework.☆15Mar 19, 2025Updated last year
- ☆18Jul 25, 2025Updated last year
- ☆24Jul 2, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ESEC/FSE'23] Hue: A User-Adaptive Parser for Hybrid Logs☆10Aug 24, 2023Updated 3 years ago
- ☆17Jan 10, 2013Updated 13 years ago
- A toolkit for testing and improving named entity recognition [ESEC/FSE'23]☆11Aug 31, 2023Updated 3 years ago
- Examples of building probabilistic models with MXNet linear algebra operators☆23Oct 24, 2017Updated 8 years ago
- Official repository of Quickscorer: a fast algorithm to rank documents with additive ensembles of regression trees.☆18Aug 11, 2016Updated 10 years ago
- convert a lot of zeros and ones to fewer real numbers☆23Jun 21, 2014Updated 12 years ago
- ☆18Apr 25, 2023Updated 3 years ago
- C99, a domain-independent algorithm for linear text segmentation by Freddy Choi☆20Nov 7, 2016Updated 9 years ago
- These are the codes used in the paper "Accelerated Gradient Boosting" by G. Biau, B. Cadre, and L. Rouvière.☆17Mar 3, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Data for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder"☆20Oct 26, 2023Updated 2 years ago
- r4c☆14Mar 2, 2021Updated 5 years ago
- Sparrow is a boosting algorithm implementation that is optimized for training on very large datasets and/or in the limited memory setting…☆21Jan 15, 2021Updated 5 years ago
- We design models that generate conversational responses for factual questions using expert answer phrases from Question Answering systems…☆21Jul 2, 2020Updated 6 years ago
- Improving Machine Translation Systems via Isotopic Replacement☆12Apr 14, 2023Updated 3 years ago
- Automatically switch between podcast camera views depending on who's talking☆10Aug 22, 2019Updated 7 years ago
- Official repository of the AAAI'2022 paper "GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning…☆108Jul 15, 2022Updated 4 years ago