LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores and LLM guardrails, for you to protect and benchmark your LLM models and pipelines.
☆72Feb 15, 2026Updated 4 months ago
Alternatives and similar repositories for langevals
Users that are interested in langevals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The platform for LLM evaluations and AI agent testing☆3,322Updated this week
- A curated list of open source repositories for AI Engineers☆134Mar 20, 2025Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆35Apr 17, 2025Updated last year
- Chat interface and library for interacting with different LLMs via Emacs.☆14Mar 19, 2025Updated last year
- ☆14Oct 17, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- EmbedDB is an ultra-lightweight vector database designed for rapid prototyping of semantic search and RAG applications. The entire implem…☆21Mar 24, 2025Updated last year
- Conversational AI assistant powered by Amazon Bedrock☆12Jun 21, 2024Updated 2 years ago
- Developer showcase of projects built on Cartesia☆20Aug 28, 2024Updated last year
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆38Oct 16, 2025Updated 8 months ago
- ☆10Feb 20, 2024Updated 2 years ago
- Forkable code execution server for LLMs, agents, and devs☆18May 7, 2025Updated last year
- Expense tracking web app☆10May 6, 2026Updated 2 months ago
- Comprehensive metrics, insights, and visualization for Agno and Crew AI applications☆26May 21, 2025Updated last year
- Lightweight note taking for macOS☆29Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- FlexEval is an LLM evaluation tool designed for practical quantitative analysis.☆16Updated this week
- ☆28Feb 11, 2026Updated 4 months ago
- SHAPR - An AI approach to predict 3D cell shapes from 2D microscopic images☆17May 31, 2023Updated 3 years ago
- ☆16Oct 24, 2023Updated 2 years ago
- Opinionated Python ORM for DynamoDB☆27Apr 19, 2019Updated 7 years ago
- 🚀 [ICLR '25] RocketEval: Efficient Automated LLM Evaluation via Grading Checklist☆17Aug 21, 2025Updated 10 months ago
- ☆15May 12, 2025Updated last year
- Very minimal (and stateless) agent framework☆44Jan 12, 2025Updated last year
- GlotEval: a unified evaluation toolkit designed to benchmark multilingual Large Language Models (LLMs) in a language-specific way☆18Nov 4, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆22Jan 13, 2025Updated last year
- Explore and Control with Adversarial Surprise☆10Jul 20, 2021Updated 4 years ago
- Reference Implementation of InfoManager actor in Care Services Discovery (CSD)☆21Aug 31, 2020Updated 5 years ago
- Easy MCP (Model Context Protocol) servers and AI agents, defined as YAML.☆19Dec 9, 2025Updated 7 months ago
- Godot Dungeon Wave Game☆13Feb 21, 2018Updated 8 years ago
- 🚀 SuperMCP - Create multiple isolated MCP servers using a single connector. Build powerful Model Context Protocol integrations for datab…☆61May 25, 2026Updated last month
- Web-based Personal Information Manager (PIM). Python, FastAPI, PostgreSQL, VUE, Quasar.☆15Sep 29, 2022Updated 3 years ago
- Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-ho…☆188Jun 29, 2026Updated last week
- InstAgent - ⚙️ Instantly transform natural language descriptions into powerful multi-agent systems 🤖 — define roles 🎭, equip them with …☆48Mar 29, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A simple repository showcasing a few LLM Evaluation strategies and leverages W&B Sweeps to optimize the LLM system.☆12Jul 11, 2023Updated 2 years ago
- ☆21Jun 12, 2024Updated 2 years ago
- There are no dumb queries, only dumb databases☆40Apr 23, 2026Updated 2 months ago
- LLM-driven automated knowledge graph construction from text using DSPy and Neo4j☆20Aug 19, 2024Updated last year
- The goal of this work is to provide user-friendly icons for priorities of tickets in JIRA or any other system. The icons in this reposito…☆14Jun 4, 2025Updated last year
- A Model Context Protocol (MCP) integration that provides Claude Desktop with autonomous browser automation capabilities. This agent enabl…☆40Feb 5, 2026Updated 5 months ago
- Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs☆34Sep 3, 2024Updated last year