mostly-ai / mostlyai-qaLinks
Synthetic Data Quality Assurance 🔎
☆65Updated last month
Alternatives and similar repositories for mostlyai-qa
Users that are interested in mostlyai-qa are comparing it to the libraries listed below
Sorting:
- Synthetic Data Engine 💎☆69Updated last week
- Synthetic Data SDK ✨☆690Updated last week
- An open-source compliance-centered evaluation framework for Generative AI models☆174Updated this week
- A curated list of awesome synthetic data tools (open source and commercial).☆228Updated last year
- LangFair is a Python library for conducting use-case level LLM bias and fairness assessments☆242Updated last week
- ☆92Updated last month
- A Lightweight Library for AI Observability☆252Updated 9 months ago
- Benchmark and optimize LLM inference across frameworks with ease☆148Updated 3 months ago
- This repository contains the resource introduced in the paper: "Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis"…☆24Updated last month
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆137Updated this week
- A general library for generating high-quality synthetic data from scratch or based on your own seed data.☆403Updated this week
- A curated list of materials on AI guardrails☆43Updated 6 months ago
- Synthetic Text Dataset Generation for LLM projects☆52Updated 2 weeks ago
- DSPydantic: Auto-Optimize Your Pydantic Models with DSPy☆67Updated last week
- Problem-Oriented Segmentation and Retrieval EMNLP 2024 Findings☆34Updated last year
- Train LLM on Hugging Face infra☆67Updated last month
- A small library of LLM judges☆306Updated 4 months ago
- A framework for evaluating RAG pipelines, specifically adapted for the legal domain.☆71Updated 4 months ago
- EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…☆92Updated 2 weeks ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆160Updated last week
- Build reliable AI and agentic applications with DataFrames☆415Updated this week
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆708Updated 2 weeks ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated last week
- Lightweight Nearest Neighbors with Flexible Backends☆322Updated 2 months ago
- ☆37Updated last year
- Unified Schema-Based Information Extraction☆355Updated this week
- Curate High Quality Datasets, Train, Evaluate and Ship! 🚀☆675Updated this week
- SUQL: Conversational Search over Structured and Unstructured Data with LLMs☆293Updated last month
- Code associated with the EMNLP 2024 Main paper: "Image, tell me your story!" Predicting the original meta-context of visual misinformatio…☆44Updated last week
- Build datasets using natural language☆551Updated 2 months ago