langwatch / langevalsLinks
LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores and LLM guardrails, for you to protect and benchmark your LLM models and pipelines.
☆57Updated last week
Alternatives and similar repositories for langevals
Users that are interested in langevals are comparing it to the libraries listed below
Sorting:
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆70Updated 7 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆78Updated 2 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆125Updated 7 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 10 months ago
- ☆89Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆145Updated last year
- auto fine tune of models with synthetic data☆75Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆105Updated last month
- A toolkit for building computer use AI agents☆162Updated this week
- Simple Graph Memory for AI applications☆86Updated 2 weeks ago
- Dynamic Metadata based RAG Framework☆75Updated 10 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆77Updated 3 months ago
- Testing and evaluation framework for voice agents☆119Updated last month
- ☆71Updated 8 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- AI real estate agent☆34Updated last year
- A user interface for DSPy☆154Updated last week
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- Natural Language Interfaces Powered by LLMs☆89Updated 10 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 6 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆91Updated 7 months ago
- ☆53Updated 7 months ago
- Python client library for improving your LLM app accuracy☆98Updated 3 months ago
- ☆72Updated 7 months ago
- Tutorial for building LLM router☆207Updated 10 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆148Updated 4 months ago
- Mine-tuning is a methodology for synchronizing human and AI attention.☆19Updated 11 months ago
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Updated last year
- GraphRAG database - hybrid graph / vector db☆127Updated 8 months ago
- ☆57Updated last year