capitalone / DataProfiler
What's in your data? Extract schema, statistics and entities from datasets
☆1,418Updated 2 months ago
Related projects: ⓘ
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆1,968Updated last month
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,866Updated last week
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆863Updated last year
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,479Updated 2 months ago
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,272Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,540Updated 4 months ago
- Build and share data reports in 100% Python☆1,369Updated 11 months ago
- Scalable identity resolution, entity resolution, data mastering and deduplication using ML☆945Updated this week
- 🐳 The stupidly simple CLI workspace for your data warehouse.☆723Updated last year
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆493Updated 2 months ago
- Data Quality assessment with one line of code☆422Updated this week
- Python API for Deequ☆704Updated last week
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆850Updated 5 months ago
- A light-weight, flexible, and expressive statistical data testing library☆3,258Updated this week
- Pandas, Polars, and Spark DataFrame comparison for humans and more!☆466Updated last week
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆947Updated 6 months ago
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆1,723Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,612Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,793Updated this week
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-host…☆1,887Updated this week
- Visualise your Kedro data and machine-learning pipelines and track your experiments.☆666Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,472Updated 2 weeks ago
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆1,779Updated this week
- A machine learning tool for automated prediction engineering. It allows you to easily structure prediction problems and generate labels f…☆492Updated last month
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆860Updated this week
- This repository is a getting started guide to Singer.☆1,258Updated 2 weeks ago
- Making data lake work for time series☆1,121Updated 3 weeks ago
- An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model perf…☆2,628Updated last week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,126Updated this week
- Generating complex, nonlinear datasets appropriate for use with deep learning/black box models which 'need' nonlinearity☆43Updated 3 months ago