gaudiy / langsmith-evaluation-helperLinks
Helper library for LangSmith that provides an interface to run evaluations by simply writing config files.
☆30Updated 3 months ago
Alternatives and similar repositories for langsmith-evaluation-helper
Users that are interested in langsmith-evaluation-helper are comparing it to the libraries listed below
Sorting:
- Simple, Pythonic building blocks to evaluate LLM applications.☆240Updated last week
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Updated 8 months ago
- Python + Markdown framework for building internal apps.☆108Updated 5 months ago
- ☆65Updated last year
- ☆16Updated 8 months ago
- ☆50Updated last year
- Evaluating the performance of LLMs on Japanese challenging financial tasks.☆22Updated 2 months ago
- ☆26Updated last year
- Pengunuity is an experimental open-source autonomous AI Agent that aims to replicate the structure of human memory.☆62Updated 2 years ago
- ☆12Updated 3 weeks ago
- Benchmark for Japanese document embedding & vector search☆30Updated last year
- codeinterpreter-api with Streamlit☆39Updated 2 years ago
- ☆27Updated 11 months ago
- ☆28Updated last year
- ☆44Updated this week
- A Slack MCP server☆105Updated 3 weeks ago
- ☆36Updated 2 years ago
- Python library that provides a unified interface for interacting with multiple Large Language Models (LLMs) from different providers.☆20Updated 3 weeks ago
- Japanese LLaMa experiment☆55Updated 10 months ago
- Anthropic Dev Container Features, including Claude Code CLI☆142Updated 3 months ago
- A Slack bot that lets you chat with 100+ LLMs via LiteLLM.☆26Updated this week
- ☆49Updated 8 months ago
- A MCP server for Vertex AI Search☆29Updated last week
- Swallowプロジェクト 事後学習済み大規模言語モデル 評価フレームワーク☆21Updated 3 weeks ago
- ☆125Updated last week
- Dify on AWS managed and easy☆50Updated last year
- Project of llm evaluation to Japanese tasks☆90Updated last week
- ☆49Updated 9 months ago
- Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"☆85Updated 3 weeks ago
- ☆24Updated last year