Drive OSS standards and tools for data curation and evaluation creation for state of the art AI agents
☆56Aug 5, 2026Updated this week
Alternatives and similar repositories for cube-harness
Users that are interested in cube-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Standardize benchmark wrapping so the community can wrap various otherwise-incompatible benchmarks uniformly and use them everywhere.☆53Jul 17, 2026Updated 3 weeks ago
- WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?☆264Apr 25, 2026Updated 3 months ago
- Helping AI practitioners better understand their datasets and models in text classification. From ServiceNow.☆72Dec 23, 2024Updated last year
- ☆17May 6, 2025Updated last year
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆432Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An enterprise deep research benchmark☆42Apr 22, 2026Updated 3 months ago
- Code for GEO-Bench V2 datasets. Made in collaboration with TUM, IBM and ServiceNow.☆30Jul 20, 2026Updated 3 weeks ago
- 🌎💪 BrowserGym, a Gym environment for web task automation☆1,312Jul 17, 2026Updated 3 weeks ago
- An evaluation environment for video analytics AI agent service.☆16May 22, 2026Updated 2 months ago
- Agent ADA is a comprehensive evaluation and data analytics framework focused on insights generation and skills assessment.☆15Aug 19, 2025Updated 11 months ago
- examples of Neural Autoregressive Flows☆14Aug 14, 2018Updated 7 years ago
- ☆24Dec 21, 2025Updated 7 months ago
- SafeArena is a benchmark for assessing the harmful capabilities of web agents☆24Apr 23, 2025Updated last year
- A web based platform for collecting human actions in reinforcement learning environments☆31Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- General agent evaluation framework☆68Jul 27, 2026Updated 2 weeks ago
- Scanner for adversarial hubs in RAG and vector databases☆17Mar 17, 2026Updated 4 months ago
- ☆26Mar 6, 2024Updated 2 years ago
- [EMNLP 2024 Tutorial] Language Agents: Foundations, Prospects, and Risks☆10Nov 27, 2024Updated last year
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆331Jul 20, 2026Updated 3 weeks ago
- Template-based generation of DAG cards from Metaflow classes, inspired by Google cards for machine learning models.☆29Dec 7, 2021Updated 4 years ago
- Code for `LLM2VEC-GEN: Generative Embeddings from Large Language Models`☆75Apr 5, 2026Updated 4 months ago
- Repository for my studies of Causal Inference☆10Dec 1, 2019Updated 6 years ago
- Evaluation package that allows benchmarking of agentic AIs from various sources and frameworks by producing statistical results which can…☆79Jun 26, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Survey for Distribution Shift☆19Jun 1, 2021Updated 5 years ago
- Context is Key: A Benchmark for Forecasting with Essential Textual Information☆100Feb 11, 2026Updated 5 months ago
- Pytorch implementation of Stable Opponent Shaping (https://openreview.net/pdf?id=SyGjjsC5tQ).☆21Jan 15, 2020Updated 6 years ago
- Brax + Pufferlib + CARBS for gpu-accelerated robotics RL☆12Jun 12, 2025Updated last year
- ☆18Jan 3, 2025Updated last year
- Experiments in applying interpretability techniques to learned reward functions.☆10Dec 11, 2020Updated 5 years ago
- Code for "Dream and Search to Control: Latent Space Planning for Continuous Control"☆12Jul 12, 2021Updated 5 years ago
- Experiments for recognising textual entailment☆14Oct 12, 2012Updated 13 years ago
- Symmetric Encryption with Language Models☆13Jun 13, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…☆27Nov 2, 2023Updated 2 years ago
- Pytorch Implementation of MuZero Unplugged for gym environment. This algorithm is capable of supporting a wide range of action and observ…☆36Jun 25, 2025Updated last year
- SDK to track cost-per-outcome for AI workflows☆18Apr 25, 2026Updated 3 months ago
- Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion☆13Jul 26, 2023Updated 3 years ago
- Ranger helps you see the forest among the trees - Ranger is an effect-size meta analysis library creating beautiful forest plots!☆12Jun 12, 2023Updated 3 years ago
- ☆15Apr 6, 2020Updated 6 years ago
- ☆23Jun 25, 2021Updated 5 years ago