The data and code for paper: "SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints"
☆22Sep 13, 2026Updated 3 weeks ago
Alternatives and similar repositories for SOPBench
Users that are interested in SOPBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jul 24, 2024Updated 2 years ago
- This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…☆23Nov 16, 2023Updated 2 years ago
- Art2Mus is a system that generates music based on digitized artworks and text by using the AudioLDM2 architecture with an added projectio…☆20Oct 20, 2025Updated 11 months ago
- [ICLR 2025] MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs☆56Mar 25, 2025Updated last year
- Code for "A Multi-Task BERT Model for Schema-Guided Dialogue State Tracking"☆14May 26, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Building self-refined guardrails via DSPy☆15Jun 25, 2026Updated 3 months ago
- This is the repository for EMNLP 2022 paper "Efficient Zero-shot Event Extraction with Context-Definition Alignment"☆11Dec 27, 2024Updated last year
- This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.☆15Jan 20, 2026Updated 8 months ago
- ☆14Aug 21, 2025Updated last year
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆20Nov 16, 2022Updated 3 years ago
- Companion code to https://arxiv.org/abs/2402.15491☆22Sep 18, 2025Updated last year
- Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization☆12Dec 3, 2024Updated last year
- 查找漏网之鱼：根据对照名单查找缺漏的名字☆10Dec 22, 2025Updated 9 months ago
- (ACL 2025) Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocation☆12May 21, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mirror of Apache Spark☆10Aug 11, 2016Updated 10 years ago
- Implementation of MetaVQA.☆12Jul 3, 2021Updated 5 years ago
- Builds a WMT18-like corpus for word-level QE with annotations in the source and target words.☆10Sep 19, 2022Updated 4 years ago
- ☆50Mar 24, 2026Updated 6 months ago
- AWS Blog post code for running feature-extraction on images using AWS Batch and Cloud Development Kit (CDK).☆21Oct 28, 2022Updated 3 years ago
- A toolkit for testing and improving named entity recognition [ESEC/FSE'23]☆11Aug 31, 2023Updated 3 years ago
- Examples of building probabilistic models with MXNet linear algebra operators☆23Oct 24, 2017Updated 8 years ago
- Whisper to Normal Speech Conversion with SC-MelGAN and SC-VQ-VAE☆15Dec 3, 2022Updated 3 years ago
- The official implementation of the paper "Self-Updatable Large Language Models by Integrating Context into Model Parameters"☆16May 18, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Unsupervised Deep Embedding for Clustering Analysis (DEC)☆28Oct 11, 2020Updated 5 years ago
- r4c☆14Mar 2, 2021Updated 5 years ago
- We design models that generate conversational responses for factual questions using expert answer phrases from Question Answering systems…☆21Jul 2, 2020Updated 6 years ago
- Improving Machine Translation Systems via Isotopic Replacement☆12Apr 14, 2023Updated 3 years ago
- Automatically switch between podcast camera views depending on who's talking☆10Aug 22, 2019Updated 7 years ago
- AAAI 2021: "UBAR: Towards Fully End-to-End Task-Oriented Dialog System with GPT-2"☆97Mar 10, 2021Updated 5 years ago
- Code to generate figures of paper "When do spectral gradient updates help in deep learning?"☆17Dec 3, 2025Updated 10 months ago
- Code and dataset for the paper: "Can Editing LLMs Inject Harm?" [AAAI'26]☆21Dec 26, 2025Updated 9 months ago
- Code and data for COLING2024 paper "Characteristic AI Agents via Large Language Models".☆25Nov 29, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- "Deriving Machine Attention from Human Rationales" EMNLP 2018☆26Feb 15, 2019Updated 7 years ago
- ☆18Mar 28, 2026Updated 6 months ago
- Reinforcement Learning examples implemented in openai gymnasium environment using python☆14Jun 2, 2025Updated last year
- DySCO: Dynamic Attention-Scaling Decoding for Long-Context LMs☆19May 30, 2026Updated 4 months ago
- A C++ library for summarizing data streams☆22Jul 26, 2019Updated 7 years ago
- ExtraTrees method for Java and R☆25Apr 7, 2023Updated 3 years ago
- Graph Learning at Scale: Characterizing and Optimizing Pre-Propagation GNNs (MLSys'25)☆19Apr 4, 2025Updated last year