Official repository for SaaS-Bench: realistic, locally deployable SaaS workflows for GUI agent evaluation.
☆105Oct 2, 2026Updated last month
Alternatives and similar repositories for SaaS-Bench
Users that are interested in SaaS-Bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluating Long-Horizon Agentic Software Development Across Version Upgrades — 115 tasks, 17 repos, 5 languages☆17May 19, 2026Updated 5 months ago
- ☆177Mar 18, 2026Updated 7 months ago
- A benchmark for scientific research agents, evaluating end-to-end paper reproduction across 12 research areas.☆44Oct 8, 2026Updated 3 weeks ago
- The official repository for paper: IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation.☆15Sep 28, 2026Updated last month
- UniScientist is designed to advance universal scientific research intelligence through a unified paradigm☆175Mar 14, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- We introduce BabyVision, a benchmark revealing the infancy of AI vision.☆267Jan 13, 2026Updated 9 months ago
- ☆30Jun 24, 2026Updated 4 months ago
- ☆13Jun 20, 2026Updated 4 months ago
- An agent framework for building and evaluating general digital agents.☆44Apr 21, 2026Updated 6 months ago
- Scalable pipeline for synthesizing verifiable RLVR training data for computer-use agents☆227Aug 13, 2026Updated 2 months ago
- Code for "SCL-RAI: Span-based Contrastive Learning with Retrieval Augmented Inference for Unlabeled Entity Problem in NER" @COLING-2022☆11Aug 20, 2022Updated 4 years ago
- Code and dataset for the paper ``Challenges to Open-Domain Constituency Parsing''☆11Sep 22, 2022Updated 4 years ago
- ☆34Sep 19, 2025Updated last year
- Code and data for CIKM-2021 paper《Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification》☆11May 3, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Apr 13, 2026Updated 6 months ago
- ☆16Oct 21, 2026Updated last week
- Verifier-integrated reasoning for formal theorem proving via RL.☆12Jul 29, 2025Updated last year
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆81Dec 10, 2024Updated last year
- [NeurIPS 2026 Meta-Agents] PostTrainBench⁰ — Can LLM agents automate LLM post-training without gradients?☆16Sep 4, 2026Updated last month
- ACL Paper Lists(machine translation)☆13Mar 23, 2022Updated 4 years ago
- MarsRL: Advancing Multi-Agent Reasoning System via Reinforcement Learning with Agentic Pipeline Parallelism☆18Nov 18, 2025Updated 11 months ago
- Code for "Improving Translation Faithfulness of Large Language Models via Augmenting Instructions"☆12Aug 26, 2023Updated 3 years ago
- The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"☆123Sep 29, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18Mar 3, 2025Updated last year
- Source code for <Sequence-Level Training for Non-Autoregressive Neural Machine Translation>.☆24Jan 17, 2022Updated 4 years ago
- Benchmarking Language Agents Under Controllable and Extreme Context Growth☆66Apr 29, 2026Updated 6 months ago
- Source code for paper "ATP: AMRize Than Parse! Enhancing AMR Parsing with PseudoAMRs" @NAACL-2022☆15Mar 31, 2023Updated 3 years ago
- ☆18Mar 28, 2026Updated 7 months ago
- Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation☆19Mar 23, 2024Updated 2 years ago
- RETROAGENT: From Solving to Evolving via Retrospective Dual Intrinsic Feedback☆32Mar 30, 2026Updated 7 months ago
- A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…☆74Jun 13, 2025Updated last year
- Harness for running and evaluating AI agents against RL environments☆296Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for ACL 2025 accepted paper titled "MPO: Multilingual Safety Alignment via Reward Gap Optimization"☆12Jun 5, 2025Updated last year
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆25Sep 26, 2024Updated 2 years ago
- the newest version of llama3，source code explained line by line using Chinese☆22Apr 19, 2024Updated 2 years ago
- G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning☆103May 20, 2025Updated last year
- OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks☆406Oct 23, 2026Updated last week
- Flash-Linear-Attention models beyond language☆21Aug 28, 2025Updated last year
- An Illusion of Progress? Assessing the Current State of Web Agents☆209Oct 27, 2026Updated last week