gaudiy / langsmith-evaluation-helper
Helper library for LangSmith that provides an interface to run evaluations by simply writing config files.
β22Updated last month
Related projects: β
- π€ A collection of AI agents includes research papers, blogs, and products focused on developing autonomous systems.β35Updated 3 months ago
- β11Updated 3 weeks ago
- Japanese LLaMa experimentβ50Updated 6 months ago
- γ2024εΉ΄ηγBERTγ«γγγγγΉγει‘β22Updated 2 months ago
- Project of llm evaluation to Japanese tasksβ67Updated last week
- GraphAI is an asynchronous data flow execution engine, which allows developers to build agentic applications by describing agent workflowβ¦β154Updated this week
- Benchmark for Japanese document embedding & vector searchβ28Updated 6 months ago
- Japanese Language Model Financial Evaluation Harnessβ64Updated last month
- An easy-to-use ML pipeline package for Python inspired by scikit-learn pipeline and PyTorch layers.β13Updated last year
- β47Updated 5 months ago
- RealPersonaChat: A Realistic Persona Chat Corpus with Interlocutors' Own Personalitiesβ44Updated 6 months ago
- FAST is an annotation tool that focuses on mobile devices. https://aclanthology.org/2021.emnlp-demo.41/β53Updated 2 years ago
- β17Updated 8 months ago
- β93Updated this week
- β24Updated 2 years ago
- A Slack Bot for summarizing arXiv papers, powered by OpenAI LLMs.β66Updated last year
- A framework for few-shot evaluation of autoregressive language models.β144Updated last week
- useful tool to use API-based LLM in an easy wayβ58Updated last week
- Mixtral-based Ja-En (En-Ja) Translation modelβ15Updated 8 months ago
- codeinterpreter-api with Streamlitβ39Updated last year
- β81Updated last year
- Ongoing research training Mixture of Expert models.β18Updated this week
- β21Updated 9 months ago
- LEIA: Facilitating Cross-Lingual Knowledge Transfer in Language Models with Entity-based Data Augmentationβ21Updated 4 months ago
- β50Updated last year
- β14Updated 2 weeks ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.β113Updated last month
- β40Updated 7 months ago
- Kannon is a wrapper for the gokart library that allows gokart tasks to be easily executed in a distributed and parallel manner on multiplβ¦β22Updated 3 months ago
- β14Updated 6 months ago