fiddler-labs / fiddler-auditorLinks
Fiddler Auditor is a tool to evaluate language models.
☆188Updated last year
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below
Sorting:
- A tool for evaluating LLMs☆428Updated last year
- Sample notebooks and prompts for LLM evaluation☆156Updated last month
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 4 months ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆319Updated 5 months ago
- Framework for LLM evaluation, guardrails and security☆114Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- Python SDK for running evaluations on LLM generated responses☆293Updated 6 months ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆194Updated 7 months ago
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆398Updated 2 years ago
- ☆180Updated last year
- ☆186Updated 2 years ago
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆116Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆309Updated last month
- Red-Teaming Language Models with DSPy☆244Updated 9 months ago
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated last year
- 🦜💯 Flex those feathers!☆255Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆81Updated 9 months ago
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆154Updated last year
- AI Verify☆39Updated last week
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆129Updated this week
- Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.☆119Updated 2 years ago
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- ☆74Updated last year
- ☆223Updated 2 years ago
- A curated list of awesome synthetic data tools (open source and commercial).☆228Updated last year
- ☆74Updated last year
- ☆172Updated 3 weeks ago
- ☆89Updated last year