google / litmusLinks
Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with a user-friendly UI for streamlining the process of building and assessing the performance of your LLM-powered applications.
☆35Updated last month
Alternatives and similar repositories for litmus
Users that are interested in litmus are comparing it to the libraries listed below
Sorting:
- Security and compliance proxy for LLM APIs☆47Updated last year
- ☆43Updated 5 months ago
- Sample GitHub Actions reusable workflows and Terraform reusable modules☆56Updated last year
- A specification for OpenInference, a semantic mapping of ML inferences☆47Updated last year
- Tailored cloud solutions based on use case, cost, and preferences using natural language with Agentic AI to research, design, price, diag…☆33Updated last month
- Sample solution to automate tedious regulatory compliance processes using multi-agent systems☆11Updated 3 months ago
- LLM model runway server☆13Updated last year
- applications of https://github.com/PrefectHQ/marvin☆12Updated last year
- Generative AI Governance for Enterprises☆16Updated 6 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated 3 months ago
- ☆59Updated last week
- A better way of testing, inspecting, and analyzing AI Agent traces.☆39Updated last week
- A tutorial on DSPy and whether automated prompt engineering lives up to the hype☆23Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆106Updated 5 months ago
- Pebblo enables developers to safely load data and promote their Gen AI app to deployment☆145Updated 3 weeks ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆78Updated 5 months ago
- Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.☆119Updated 2 years ago
- 😎 Awesome list of resources about using and building AI software development systems☆111Updated last year
- Python module for running GPTScript☆14Updated last month
- Code and notebooks associated with my blogposts☆65Updated 7 months ago
- Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.☆12Updated 2 years ago
- ☆11Updated 8 months ago
- ☆1Updated last year
- CCCS security control profiles expressed using OSCAL☆14Updated last month
- Interactive workflows for creating AI intelligence reports from real-world data sources☆83Updated 3 weeks ago
- Helm charts to deploy Weaviate to k8s☆60Updated this week
- MirrorDataGenerator is a python tool that generates synthetic data based on user-specified causal relations among features in the data. I…☆23Updated 3 years ago
- DevOps AI Assistant CLI. Ask questions about your AWS services, cloudwatch metrics, and billing.☆68Updated 11 months ago
- Constrain LLM output☆112Updated last year
- Knowledge for GPTScript☆29Updated 8 months ago