data-catering / data-caterer
Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.
☆51Updated last month
Alternatives and similar repositories for data-caterer:
Users that are interested in data-caterer are comparing it to the libraries listed below
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆89Updated this week
- Unity Catalog UI☆40Updated 7 months ago
- A DataOps framework for building a lakehouse.☆50Updated this week
- Sample code to collect Apache Iceberg metrics for table monitoring☆26Updated 8 months ago
- The Data Product Descriptor Specification (DPDS) Repository☆77Updated 3 months ago
- Quickstart for any service☆143Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆140Updated 2 weeks ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated 3 weeks ago
- Python package for querying iceberg data through duckdb.☆64Updated last year
- The bridge to effortless multi-engine data applications, currently supports Snowflake ❄️ and DuckDB 🦆☆177Updated last week
- dbt's adapter for dremio☆48Updated 2 years ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 10 months ago
- Yet Another (Spark) ETL Framework☆20Updated last year
- Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data type…☆49Updated this week
- dbt (data build tool) adapter for the Dremio☆51Updated 2 weeks ago
- A Table format agnostic data sharing framework☆38Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 8 months ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Data Mesh Architecture☆75Updated 9 months ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆26Updated last year
- New generation opensource data stack☆66Updated 2 years ago
- Delta Lake Documentation☆49Updated 9 months ago
- Delta Lake helper methods. No Spark dependency.☆23Updated 7 months ago
- Quick Guides from Dremio on Several topics☆70Updated 3 months ago
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆23Updated 6 months ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆68Updated 6 months ago
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated last year
- Discover the simplicity and strength of Duckdb, dbt, and Iceberg in this project. Create an efficient, versatile data analytics solution …☆34Updated last year
- Enables Python developers to leverage Debezium's CDC capabilities with custom event handlers and seamless integration.☆24Updated last month
- API Framework heavily relying on the power of DuckDB and DuckDB extensions. Ready to build performant and cost-efficient APIs on top of B…☆28Updated 3 weeks ago