gaudiy / langsmith-evaluation-helperLinks
Helper library for LangSmith that provides an interface to run evaluations by simply writing config files.
☆31Updated 6 months ago
Alternatives and similar repositories for langsmith-evaluation-helper
Users that are interested in langsmith-evaluation-helper are comparing it to the libraries listed below
Sorting:
- Simple, Pythonic building blocks to evaluate LLM applications.☆246Updated last month
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Updated 11 months ago
- ☆69Updated 2 years ago
- ☆49Updated last week
- Evaluating the performance of LLMs on Japanese challenging financial tasks.☆28Updated 5 months ago
- Benchmark for Japanese document embedding & vector search☆29Updated last year
- Python + Markdown framework for building internal apps.☆109Updated 8 months ago
- ☆16Updated 11 months ago
- Personal collection of sample code and experiments using the Swarm multi-agent framework.☆10Updated last year
- codeinterpreter-api with Streamlit☆39Updated 2 years ago
- ☆28Updated last year
- ☆50Updated last year
- Python library that provides a unified interface for interacting with multiple Large Language Models (LLMs) from different providers.☆20Updated 3 months ago
- Japanese LLaMa experiment☆54Updated this week
- Japanese / English Bilingual LLM☆28Updated last week
- Pengunuity is an experimental open-source autonomous AI Agent that aims to replicate the structure of human memory.☆62Updated 2 years ago
- Swallowプロジェクト 事後学習済み大規模言語モデル 評価フレームワーク☆24Updated 2 months ago
- ☆36Updated 2 years ago
- A MCP server for Vertex AI Search☆34Updated this week
- ☆27Updated last year
- This Repositry is an experiment with an agent that searches documents and asks questions repeatedly in response to the main question. It …☆19Updated 2 years ago
- ☆13Updated 9 months ago
- Anthropic Dev Container Features, including Claude Code CLI☆184Updated 2 weeks ago
- ✂️ OpenProvence: Open-Source, Efficient, and Robust Context Pruning for Retrieval-Augmented Generation☆36Updated last month
- A Slack MCP server☆106Updated 3 months ago
- ☆275Updated last year
- GraphAI is an asynchronous data flow execution engine, which allows developers to build agentic applications by describing agent workflow…☆361Updated this week
- 🦉AIProxy is a reverse proxy for ChatGPT API that provides monitoring, logging, and filtering requests and responses.☆57Updated last year
- ☆26Updated last year
- ☆133Updated 3 months ago