fiddler-labs / fiddler-auditorLinks
Fiddler Auditor is a tool to evaluate language models.
☆181Updated last year
Alternatives and similar repositories for fiddler-auditor
Users that are interested in fiddler-auditor are comparing it to the libraries listed below
Sorting:
- A tool for evaluating LLMs☆418Updated last year
- ☆185Updated last year
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆119Updated 3 weeks ago
- Sample notebooks and prompts for LLM evaluation☆128Updated last week
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year
- Python SDK for running evaluations on LLM generated responses☆280Updated 2 weeks ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆182Updated last month
- ☆52Updated last year
- ☆77Updated last year
- Red-Teaming Language Models with DSPy☆193Updated 3 months ago
- ☆164Updated last year
- ☆74Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆240Updated 7 months ago
- 🦜💯 Flex those feathers!☆246Updated 7 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆110Updated 8 months ago
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆150Updated 7 months ago
- ☆89Updated last year
- ☆166Updated this week
- Leverage your LangChain trace data for fine tuning☆41Updated 10 months ago
- Collection of recipes aiding Gen AI model development☆109Updated last week
- Mistral + Haystack: build RAG pipelines that rock 🤘☆104Updated last year
- ☆194Updated last year
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆69Updated this week
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆94Updated last year
- Automated knowledge graph creation SDK☆122Updated 6 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆321Updated 6 months ago
- ☆16Updated last year
- 🚀 A list of Haystack Integrations, maintained by the community or deepset.☆88Updated this week