Factual / parquet-rewriter
A library to mutate parquet files
☆19Updated last year
Alternatives and similar repositories for parquet-rewriter:
Users that are interested in parquet-rewriter are comparing it to the libraries listed below
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Convert JSON files to Parquet using PyArrow☆96Updated last year
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- A pyspark lib to validate data quality☆18Updated 2 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Read Delta tables without any Spark☆47Updated 11 months ago
- Activity Schema dbt package☆14Updated last year
- Profiles the data, validates the schema and runs data quality checks and produces a report☆20Updated 5 years ago
- Ibis analytics, with Ibis (and more!)☆20Updated 5 months ago
- A facebook for data☆26Updated 5 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆50Updated last year
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆79Updated 2 weeks ago
- Data Catalog for Databases and Data Warehouses☆33Updated last year
- Parse dbt artifacts and search dbt models with Algolia☆52Updated 3 years ago
- A small Python module containing quick utility functions for standard ETL processes.☆34Updated last week
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- Amundsen Gremlin☆21Updated 2 years ago
- event-triggered plugins for airflow☆21Updated 5 years ago
- A component which takes nifi flow xml file as input and converts it into terraform script for creating/updating a flow on nifi☆28Updated 3 years ago
- dotML is a light-weight semantic layer written in Python.☆33Updated last year
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Utility functions for dbt projects running on Spark☆31Updated 2 weeks ago
- ☆24Updated 2 years ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆61Updated 2 years ago
- Tools for working with Singer Taps and Targets☆59Updated 6 months ago
- A CLI and library to run Singer Taps and Targets☆34Updated 2 years ago