A Benchmark for Evaluating Multi-Hop, Multi-Source Tool-Calling in AI Agents
☆78Nov 13, 2026Updated this week
Alternatives and similar repositories for vakra
Users that are interested in vakra are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A library of components to help agent builders boost their agent performance (tool-calling, instruction following, policy, etc.)☆121Aug 19, 2026Updated 3 months ago
- Scarfbench: Self-Contained Application Refactoring Benchmark☆37Oct 19, 2026Updated last month
- CUGA is an open-source generalist agent harness for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integr…☆1,189Updated this week
- ☆36May 9, 2025Updated last year
- General agent evaluation framework☆80Sep 15, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An open source benchmarking framework for IT automation☆522Updated this week
- Test-time optimization of query embedding representations for zero-shot classification and retrieval☆15Oct 7, 2026Updated last month
- Agentic Claude Code skills for academic writing: review simulation, revision, and prose improvement.☆20Oct 22, 2026Updated 3 weeks ago
- Prompt Declaration Language (PDL) is a declarative prompt programming language.☆317Updated this week
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated last month
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Nov 10, 2026Updated last week
- Code repository for CISO agent as part of ITBench☆22May 8, 2025Updated last year
- Open protocol for communication between AI agents, applications, and humans.☆1,020Aug 25, 2025Updated last year
- Open source no-code system for text annotation and building of text classifiers☆275May 26, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆14Dec 1, 2025Updated 11 months ago
- Formalization of Machine Learning Theory with Applications to Program Synthesis☆79Sep 29, 2026Updated last month
- ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.☆12Mar 23, 2023Updated 3 years ago
- A Python library for inference-time scaling LLMs☆40Sep 28, 2026Updated last month
- Build production-ready AI agents in both Python and Typescript.☆3,461Updated this week
- Comprehensive LLM Error Analysis and Reporting☆65Nov 10, 2026Updated last week
- The IBM Developer Workshop Template (https://ibm.github.io/workshop-template/)☆13Sep 17, 2025Updated last year
- Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.☆12Updated this week
- A visual web interface powered by AI for quantum computing for development with Qiskit (PoC)☆11Dec 18, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The Maximo MCP Server is a Model Context Protocol server that connects AI assistants (like Antigravity, Cursor, or VS Code Copilot) direc…☆11Sep 17, 2026Updated 2 months ago
- ☆19Apr 15, 2024Updated 2 years ago
- Code that translates grammar into PDDL, runs a planner to produce multiple plans, translates plans into trainable lale pipelines and trai…☆19Sep 17, 2025Updated last year
- Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.☆24Sep 4, 2024Updated 2 years ago
- Mellea is a library for writing generative programs.☆1,851Updated this week
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 3 years ago
- ☆13Jan 16, 2026Updated 10 months ago
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Nov 10, 2026Updated last week
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆215Nov 7, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ACPBench: Reasoning about Action, Change, and Planning. A benchmark designed to evaluate the fundamental reasoning abilities in the dom…☆36Oct 16, 2026Updated last month
- A Symbolic Emulator for Shuffle Synthesis on the NVIDIA PTX Code☆16Mar 19, 2023Updated 3 years ago
- Code for AttriBoT from "AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attribution"☆15Apr 21, 2025Updated last year
- Long-form factuality assessor for large language models☆45Updated this week
- Text-to-SQL Evaluation Toolkit: A modular framework for evaluating natural language to SQL systems☆19Updated this week
- Official github repo for "Fractional Reasoning via Latent Steering Vectors Improves Inference Time Compute"☆18Jun 30, 2025Updated last year
- The prime repository for state-of-the-art Multilingual Question Answering research and development.☆741Sep 18, 2025Updated last year
Are these results useful?