Drive OSS standards and tools for data curation and evaluation creation for state of the art AI agents
☆57Sep 30, 2026Updated last week
Alternatives and similar repositories for cube-harness
Users that are interested in cube-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Standardize benchmark wrapping so the community can wrap various otherwise-incompatible benchmarks uniformly and use them everywhere.☆55Sep 30, 2026Updated last week
- WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?☆274Sep 28, 2026Updated last week
- Helping AI practitioners better understand their datasets and models in text classification. From ServiceNow.☆72Dec 23, 2024Updated last year
- ☆17May 6, 2025Updated last year
- MiniTouch is a ServiceNow Research project that was started at Element AI.☆14Jul 5, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆434Aug 5, 2026Updated 2 months ago
- An enterprise deep research benchmark☆43Apr 22, 2026Updated 5 months ago
- Causal discovery with typed directed acyclic graphs (t-DAG). This is a ServiceNow Research project that was started at Element AI.☆13Jul 6, 2023Updated 3 years ago
- 🌎💪 BrowserGym, a Gym environment for web task automation☆1,394Updated this week
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆646Updated this week
- Agent ADA is a comprehensive evaluation and data analytics framework focused on insights generation and skills assessment.☆15Aug 19, 2025Updated last year
- GroundCUA☆135Mar 24, 2026Updated 6 months ago
- TACTiS-2: Better, Faster, Simpler Attentional Copulas for Multivariate Time Series, from ServiceNow Research☆140May 3, 2024Updated 2 years ago
- Codebase for EnterpriseOps-Gym from ServiceNow☆135Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆23Dec 21, 2025Updated 9 months ago
- SafeArena is a benchmark for assessing the harmful capabilities of web agents☆26Apr 23, 2025Updated last year
- ☆10Nov 8, 2020Updated 5 years ago
- A web based platform for collecting human actions in reinforcement learning environments☆31Sep 10, 2026Updated 3 weeks ago
- Scanner for adversarial hubs in RAG and vector databases☆19Mar 17, 2026Updated 6 months ago
- Official Repository of Paper "Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs"☆15Sep 25, 2025Updated last year
- BERT baselines for extractive question answering on coqa (https://stanfordnlp.github.io/coqa/)☆10Jan 27, 2020Updated 6 years ago
- ☆14Jul 18, 2025Updated last year
- Visual Verb Sense Disambiguation☆13Apr 26, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [EMNLP 2024 Tutorial] Language Agents: Foundations, Prospects, and Risks☆10Nov 27, 2024Updated last year
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆336Sep 19, 2026Updated 3 weeks ago
- Automatically generate documentation for Python scripts.☆16Dec 21, 2022Updated 3 years ago
- This repository contains the code for RL for POMDPs through learning an Approximate Information State.☆23Nov 29, 2025Updated 10 months ago
- Repository for my studies of Causal Inference☆10Dec 1, 2019Updated 6 years ago
- source code of AISTATS 2020 paper: Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphs☆11Jun 21, 2022Updated 4 years ago
- True Few-Shot BioIE: Benchmarking GPT-3 In-Context and Small PLM Fine-Tuning☆12Jul 6, 2022Updated 4 years ago
- Context is Key: A Benchmark for Forecasting with Essential Textual Information☆102Feb 11, 2026Updated 7 months ago
- SyGra - Graph-oriented Synthetic data generation Pipeline☆93Aug 26, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆18Jan 3, 2025Updated last year
- Gym wrapper for pysc2☆10Sep 16, 2022Updated 4 years ago
- French Machine Reading for Question Answering☆18Sep 21, 2022Updated 4 years ago
- Ranger helps you see the forest among the trees - Ranger is an effect-size meta analysis library creating beautiful forest plots!☆12Jun 12, 2023Updated 3 years ago
- Counterfactual explanations for Reinforcement Learning agents on Atari☆12Apr 3, 2023Updated 3 years ago
- Codebase for Embedding Propagation: Smoother Manifold for Few-Shot Classification. This is a ServiceNow Research project that was started…☆211Jun 27, 2022Updated 4 years ago
- bilevel_augment is a ServiceNow Research project that was started at Element AI.☆27Jun 23, 2022Updated 4 years ago