langwatch / langevals
LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores and LLM guardrails, for you to protect and benchmark your LLM models and pipelines.
☆50Updated 2 weeks ago
Alternatives and similar repositories for langevals:
Users that are interested in langevals are comparing it to the libraries listed below
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 6 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 9 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆75Updated last month
- RAG example using DSPy, Gradio, FastAPI☆78Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated 11 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆141Updated last year
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆90Updated 6 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- Testing and evaluation framework for voice agents☆107Updated 2 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 5 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆66Updated 5 months ago
- Dynamic Metadata based RAG Framework☆72Updated 8 months ago
- Routing on Random Forest (RoRF)☆141Updated 6 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆59Updated 7 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆121Updated last month
- ☆92Updated last year
- ☆45Updated last year
- auto fine tune of models with synthetic data☆75Updated last year
- Build reliable, secure, and production-ready AI apps easily.☆70Updated this week
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated 2 months ago
- ☆72Updated 5 months ago
- ☆88Updated last year
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆109Updated 8 months ago
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆119Updated last year
- Solving data for LLMs - Create quality synthetic datasets!☆145Updated 2 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- AI real estate agent☆34Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 9 months ago
- WIP - Allows you to create DSPy pipelines using ComfyUI☆187Updated 4 months ago
- ☆44Updated 10 months ago