langwatch / langevalsLinks
LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores and LLM guardrails, for you to protect and benchmark your LLM models and pipelines.
☆69Updated last week
Alternatives and similar repositories for langevals
Users that are interested in langevals are comparing it to the libraries listed below
Sorting:
- Tutorial for building LLM router☆239Updated last year
- Routing on Random Forest (RoRF)☆235Updated last year
- ☆74Updated last year
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆139Updated 4 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆89Updated 2 weeks ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆132Updated last year
- A toolkit for building computer use AI agents☆180Updated 6 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆148Updated last year
- FastAPI wrapper around DSPy☆285Updated last year
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated last year
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆263Updated last year
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆108Updated last year
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆93Updated last year
- Testing and evaluation framework for voice agents☆161Updated 6 months ago
- A simple Python sandbox for helpful LLM data agents☆299Updated last year
- Solving data for LLMs - Create quality synthetic datasets!☆150Updated 11 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆72Updated last month
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- A Lightweight Library for AI Observability☆252Updated 10 months ago
- Automated knowledge graph creation SDK☆122Updated last year
- SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.☆25Updated last year
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆95Updated 2 months ago
- RAG example using DSPy, Gradio, FastAPI☆87Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 4 months ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆113Updated 5 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- 🤖 Headless IDE for AI agents☆200Updated 2 months ago
- Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.☆290Updated last week
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆156Updated last year