google / litmusLinks
Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with a user-friendly UI for streamlining the process of building and assessing the performance of your LLM-powered applications.
☆37Updated 3 months ago
Alternatives and similar repositories for litmus
Users that are interested in litmus are comparing it to the libraries listed below
Sorting:
- Security and compliance proxy for LLM APIs☆49Updated 2 years ago
- ☆20Updated this week
- Sample GitHub Actions reusable workflows and Terraform reusable modules☆56Updated last year
- LLM model runway server☆13Updated 2 years ago
- Graph Retriever Analysis and Performance Evaluation☆23Updated last month
- Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.☆12Updated 2 years ago
- This repository is a combination of llama workflows and agents together which is a powerful concept.☆17Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆118Updated 8 months ago
- Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.☆83Updated 2 weeks ago
- ☆44Updated this week
- Python module for running GPTScript☆13Updated 5 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated 3 weeks ago
- DevOps AI Assistant CLI. Ask questions about your AWS services, cloudwatch metrics, and billing.☆70Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆39Updated last week
- A simple screen parsing tool towards pure vision based GUI agent☆13Updated 6 months ago
- A specification for OpenInference, a semantic mapping of ML inferences☆47Updated last year
- Test Generation for Prompts☆140Updated last week
- A curated list of resources about all things Gemini in Google Cloud.☆75Updated 9 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆53Updated 11 months ago
- 😎 Awesome list of resources about using and building AI software development systems☆111Updated last year
- Generative AI Governance for Enterprises☆16Updated 9 months ago
- ☆171Updated last year
- A tutorial on DSPy and whether automated prompt engineering lives up to the hype☆24Updated last year
- ☆12Updated last month
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆79Updated 8 months ago
- Inference examples☆61Updated last month
- Knowledge for GPTScript☆29Updated 11 months ago
- Langtrace SDK for Python Applications☆40Updated 2 months ago
- ☆46Updated 8 months ago
- ☆35Updated 2 weeks ago