google / litmusLinks
Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with a user-friendly UI for streamlining the process of building and assessing the performance of your LLM-powered applications.
☆41Updated 6 months ago
Alternatives and similar repositories for litmus
Users that are interested in litmus are comparing it to the libraries listed below
Sorting:
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆132Updated 11 months ago
- Security and compliance proxy for LLM APIs☆50Updated 2 years ago
- Sample solution to automate tedious regulatory compliance processes using multi-agent systems☆22Updated 9 months ago
- Knowledge for GPTScript☆29Updated last year
- Pebblo enables developers to safely load data and promote their Gen AI app to deployment☆148Updated 7 months ago
- AgentSmithy provides a series of tools and templates that simplify the process of building and deploying custom AI agents on Google Cloud…☆69Updated last week
- Python module for running GPTScript☆14Updated last month
- A GitHub Action for running a Google Cloud Vertex AI notebook.☆25Updated 4 months ago
- Summarizes document using OCR and Vertex Generative AI LLM☆148Updated last month
- An example app that explores the challenges of building production-quality AI applications.☆42Updated this week
- I will be adding different kind of opensource data extraction tools code using python☆10Updated last year
- ☆144Updated this week
- A curated list of resources about all things Gemini in Google Cloud.☆79Updated last year
- ☆48Updated 3 weeks ago
- Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.☆12Updated 2 years ago
- An example extension in go using retrevial-augmented generation☆96Updated 6 months ago
- ☆45Updated last year
- Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.☆85Updated 3 weeks ago
- ☆31Updated last week
- Test Generation for Prompts☆148Updated last week
- A proxy sidecar to access Gemini models via OpenAI and Ollama APIs☆178Updated 2 months ago
- ☆76Updated this week
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆44Updated this week
- ☆37Updated last week
- A tutorial on DSPy and whether automated prompt engineering lives up to the hype☆25Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆82Updated 11 months ago
- Adding NeMo Guardrails to a LlamaIndex RAG pipeline☆41Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆34Updated 9 months ago
- AI aware proxy☆19Updated last year
- Declaratively define and run required tools across environments, from local development to containerized cloud deployments.☆127Updated last week