Research infra for creating RL environments, post-training, and evals
☆286Jul 15, 2026Updated this week
Alternatives and similar repositories for benchflow
Users that are interested in benchflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆45Updated this week
- Ship billing in minutes, not weeks☆30Jan 26, 2026Updated 5 months ago
- SWE-Marathon: an ultra long-horizon SWE benchmark☆104Updated this week
- A Python library for LLM-based evaluation using weighted rubrics.☆67Feb 3, 2026Updated 5 months ago
- Code for paper https://arxiv.org/abs/2501.00522☆15Apr 28, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- SkillsBench evaluates how well skills work and how effective agents are at using them.☆1,502Updated this week
- GeniusAI is a cutting-edge AI tool that seamlessly integrates advanced features, including Clerk Authentication, Open AI and Replicate AI…☆11Mar 31, 2024Updated 2 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Updated this week
- AI Chatbot Starter Kit: An open-source, extensible framework for rapidly developing custom AI chatbots with integrations for popular data…☆22Aug 7, 2024Updated last year
- python library to perform Locality-Sensitive Hashing for faster nearest neighbors search in high dimensional data☆19Aug 15, 2024Updated last year
- Interface for GenAI-Arena [NeurIPS24]☆16Feb 27, 2024Updated 2 years ago
- Learn DSPy's core abstractions while building a deep research agent.☆43Mar 8, 2026Updated 4 months ago
- Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.☆41Apr 29, 2024Updated 2 years ago
- A local-first evidence layer for agent work, capturing what the agent sees, does, and changes.☆88Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆16Updated this week
- The AI Adoption and Management Framework (AI-AMF) is a structured methodology designed to help organizations successfully integrate artif…☆16Feb 18, 2025Updated last year
- Export contacts from the macOS Contacts app in vCard format to Markdown files with structured data.☆17Jul 8, 2024Updated 2 years ago
- Effortlessly process invoices with AI! This project uses the Llama3.2 Vision Model for OCR, converting invoice images into structured, ma…☆12Feb 5, 2025Updated last year
- Watsonx Orchestrate and Maximo Application Suite reference architecture for the creation and integration of a Maximo AI Assistant.☆12Sep 18, 2025Updated 9 months ago
- ☆81Jun 25, 2026Updated 3 weeks ago
- A powerful integration that combines Browserbase's Stagehand with Mastra for advanced web automation, scraping, and AI-powered web intera…☆41May 11, 2026Updated 2 months ago
- Personal project, Generative AI, Streamlit, Python☆53Apr 30, 2025Updated last year
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An enhanced TypeScript SDK for OpenAI API with built-in context management, proxy support, streaming, and enhanced error handling. Includ…☆12Oct 11, 2024Updated last year
- A curated list of awesome NetSuite AI resources, tools, articles, and community contributions focused on the NetSuite AI Connector Servic…☆25Sep 9, 2025Updated 10 months ago
- Xcode MCP Server xcf is a 100% Swift based allowing you to integrate Xcode with your favorite AI IDE or MCP Client☆12Mar 30, 2026Updated 3 months ago
- This repository contains a ready-to-use boilerplate for quickly setting up and working with crewai. It provides essential configurations …☆11Sep 11, 2024Updated last year
- An Airflow-based pipeline that fetches data from a free API, cleans and transforms it, and saves it to a database—ready for downstream ma…☆15Mar 26, 2025Updated last year
- Cybersecurity Ontology (CyberOnto) and Situational Awareness (CyberSA) help teamwork in Cyber Incident Responses, Control, Containment, a…☆10Sep 15, 2022Updated 3 years ago
- A lightweight MCP server that integrates with Apple Notes to create a personal memory system for AI. Easily recall and save information f…☆12Apr 7, 2025Updated last year
- Master the techniques of function-calling and structured data extraction with LLMs. Learn to enhance LLM capabilities, integrate web serv…☆12Jun 29, 2024Updated 2 years ago
- Harmonizing N8N, NocoDB, One-API, and Fastchat to forge an accessible and intuitive AI flows integration platform. ⚡ 融合N8N、NocoDB、One-AP…☆12Jan 5, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- umContentCreator is a package for Umbraco that enhances your content editing experience by integrating AI-powered content generation.☆10Feb 11, 2026Updated 5 months ago
- ☆27Jan 14, 2025Updated last year
- ☆133Mar 31, 2026Updated 3 months ago
- Run, deploy and monitor CLI agents in secure cloud sandboxes.☆74Jul 4, 2026Updated last week
- AI Evaluation Platform☆49May 26, 2025Updated last year
- See Through Your Models☆401Jul 8, 2025Updated last year
- Transform your CapsLock into an AI key! This AutoHotkey app puts powerful AI capabilities right at your fingertips, supercharging your Wi…☆22Oct 31, 2025Updated 8 months ago