data-catering / data-caterer
Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.
☆53Updated 2 months ago
Alternatives and similar repositories for data-caterer:
Users that are interested in data-caterer are comparing it to the libraries listed below
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆108Updated this week
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆24Updated 7 months ago
- Unity Catalog UI☆40Updated 8 months ago
- The Data Product Descriptor Specification (DPDS) Repository☆77Updated 3 months ago
- A DataOps framework for building a lakehouse.☆50Updated this week
- Sample code to collect Apache Iceberg metrics for table monitoring☆26Updated 8 months ago
- a curated list of awesome lakehouse frameworks, applications, etc☆27Updated 2 months ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆145Updated last month
- Python package for querying iceberg data through duckdb.☆65Updated last year
- Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data type…☆51Updated 3 weeks ago
- Data Mesh Architecture☆78Updated 10 months ago
- A Table format agnostic data sharing framework☆38Updated last year
- dbt (data build tool) adapter for the Dremio☆51Updated this week
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 10 months ago
- Make dbt great again! Enables end user to extend dbt to his/her needs☆70Updated last week
- The bridge to effortless multi-engine data applications, currently supports Snowflake ❄️ and DuckDB 🦆☆179Updated this week
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆50Updated 5 months ago
- Quickstart for any service☆146Updated this week
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated last year
- Real-time deduplication and temporal joins for streaming data☆27Updated this week
- Yet Another (Spark) ETL Framework☆21Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 8 months ago
- ☆34Updated 3 weeks ago
- dbt's adapter for dremio☆48Updated 2 years ago
- The Modern Data Stack in a Python package☆49Updated last year
- An open specification for data products in Data Mesh☆59Updated 6 months ago
- Data Mesh Manager (Community Edition)☆36Updated last month
- Discover the simplicity and strength of Duckdb, dbt, and Iceberg in this project. Create an efficient, versatile data analytics solution …☆34Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset☆53Updated 5 months ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆27Updated 3 months ago