langwatch / langevals
LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores and LLM guardrails, for you to protect and benchmark your LLM models and pipelines.
☆46Updated last week
Alternatives and similar repositories for langevals:
Users that are interested in langevals are comparing it to the libraries listed below
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆72Updated last week
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 4 months ago
- Python client library for improving your LLM app accuracy☆96Updated last month
- auto fine tune of models with synthetic data☆74Updated last year
- Dynamic Metadata based RAG Framework☆72Updated 7 months ago
- AI real estate agent☆34Updated last year
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆59Updated 7 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- Data extraction with LLM on CPU☆112Updated last year
- ☆75Updated last year
- An open-source Discord bot, created using LlamaIndex, that - Listens to your server conversations, continuously learns from them & answe…☆75Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆75Updated last month
- Web App for generating synthetic data☆46Updated 6 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 4 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆104Updated 3 months ago
- RAG example using DSPy, Gradio, FastAPI☆75Updated 11 months ago
- Simple examples using Argilla tools to build AI☆53Updated 3 months ago
- Natural Language Interfaces Powered by LLMs☆91Updated 7 months ago
- Testing and evaluation framework for voice agents☆97Updated 3 weeks ago
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆73Updated last year
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆81Updated 10 months ago
- converts url content into JSON with a simple prefix☆66Updated 10 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆63Updated 4 months ago
- Conduct consumer interviews with synthetic focus groups using LLMs and LangChain☆43Updated last year
- ☆71Updated 4 months ago
- A reimplementation of langgraph's customer support example in Rasa's CALM paradigm and a quantiative evaluation of the 2 approaches☆76Updated last month
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆83Updated last month
- ☆76Updated 9 months ago
- ☆92Updated last year