gaudiy / langsmith-evaluation-helperLinks
Helper library for LangSmith that provides an interface to run evaluations by simply writing config files.
☆31Updated 6 months ago
Alternatives and similar repositories for langsmith-evaluation-helper
Users that are interested in langsmith-evaluation-helper are comparing it to the libraries listed below
Sorting:
- Simple, Pythonic building blocks to evaluate LLM applications.☆246Updated last month
- ☆49Updated last week
- ☆69Updated 2 years ago
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Updated 11 months ago
- Python library that provides a unified interface for interacting with multiple Large Language Models (LLMs) from different providers.☆20Updated 3 months ago
- Python + Markdown framework for building internal apps.☆109Updated 8 months ago
- Benchmark for Japanese document embedding & vector search☆29Updated last year
- ☆28Updated last year
- ☆50Updated last year
- codeinterpreter-api with Streamlit☆39Updated 2 years ago
- Swallowプロジェクト 事後学習済み大規模言語モデル 評価フレームワーク☆24Updated 2 months ago
- Evaluating the performance of LLMs on Japanese challenging financial tasks.☆28Updated 5 months ago
- ☆26Updated last year
- ☆16Updated 11 months ago
- ☆27Updated last year
- ☆13Updated 9 months ago
- Japanese LLaMa experiment☆54Updated 2 months ago
- A Slack MCP server☆106Updated 3 months ago
- Official implementation of "TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models"☆120Updated 2 months ago
- Personal collection of sample code and experiments using the Swarm multi-agent framework.☆10Updated last year
- A Slack bot that lets you chat with 100+ LLMs via LiteLLM.☆29Updated this week
- ☆51Updated 10 months ago
- ☆49Updated last year
- ☆133Updated 3 months ago
- ✂️ OpenProvence: Open-Source, Efficient, and Robust Context Pruning for Retrieval-Augmented Generation☆36Updated last month
- ☆274Updated last year
- A command-line tool that uses Gemini API to generate summaries of academic papers.☆48Updated 7 months ago
- 🦉AIProxy is a reverse proxy for ChatGPT API that provides monitoring, logging, and filtering requests and responses.☆57Updated last year
- ☆16Updated 11 months ago
- Tiny Bolt ⚡️ app demonstrating how to build Slack apps utilizing Slack's new features and New Relic APIs☆13Updated 6 years ago