langwatch / langevalsLinks
LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores and LLM guardrails, for you to protect and benchmark your LLM models and pipelines.
☆60Updated this week
Alternatives and similar repositories for langevals
Users that are interested in langevals are comparing it to the libraries listed below
Sorting:
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆126Updated 9 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆82Updated 3 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆78Updated 5 months ago
- Tutorial for building LLM router☆216Updated 11 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆108Updated 3 months ago
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆68Updated 2 months ago
- A list of AI memory projects☆168Updated 6 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆145Updated last year
- Testing and evaluation framework for voice agents☆128Updated last month
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆132Updated last month
- A reimplementation of langgraph's customer support example in Rasa's CALM paradigm and a quantiative evaluation of the 2 approaches☆80Updated 3 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆62Updated 11 months ago
- A toolkit for building computer use AI agents☆168Updated 2 weeks ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆111Updated 11 months ago
- Dynamic Metadata based RAG Framework☆75Updated 11 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- 🤖 Headless IDE for AI agents☆192Updated 2 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated 9 months ago
- ☆71Updated 8 months ago
- A Lightweight Library for AI Observability☆246Updated 4 months ago
- FastAPI wrapper around DSPy☆253Updated last year
- Routing on Random Forest (RoRF)☆176Updated 9 months ago
- Automating enterprise workflows with multimodal agents☆108Updated 9 months ago
- A user interface for DSPy☆162Updated last month
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆84Updated 9 months ago
- ☆89Updated last year
- SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.☆25Updated 8 months ago
- auto fine tune of models with synthetic data☆76Updated last year
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆264Updated last year