mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
☆2,079Updated last year
Alternatives and similar repositories for mara-pipelines:
Users that are interested in mara-pipelines are comparing it to the libraries listed below
- Extract Transform Load for Python 3.5+☆1,590Updated last year
- Python Extract Transform and Load Tables of Data☆1,264Updated 2 weeks ago
- A curated list of awesome ETL frameworks, libraries, and software.☆3,388Updated 8 months ago
- This repository is a getting started guide to Singer.☆1,297Updated 7 months ago
- Writes the Singer format from Python☆556Updated 3 weeks ago
- Quilt is a data mesh for connecting people with actionable data☆1,334Updated this week
- ETL best practices with airflow, with examples☆1,330Updated 6 months ago
- Data Migration for the Blaze Project☆1,004Updated 2 years ago
- Template Language for SQL with Automatic Bind Parameter Extraction☆832Updated last year
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,503Updated 4 months ago
- Curated list of resources about Apache Airflow☆3,768Updated 8 months ago
- Data Pipeline Framework using the singer.io spec☆647Updated last week
- Official repository for pygrametl - ETL programming in Python☆296Updated 3 weeks ago
- Extract, Transform, Load: Any SQL Database in 4 lines of Code.☆557Updated 5 years ago
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,292Updated 3 weeks ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,556Updated 2 weeks ago
- Python Stream Processing☆6,786Updated 8 months ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,341Updated last month
- Guides and docs to help you get up and running with Apache Airflow.☆808Updated 2 years ago
- Compare tables within or across databases☆2,965Updated 11 months ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,403Updated last week
- Real-time stream processing for python☆1,257Updated 5 months ago
- Pinball is a scalable workflow manager☆1,044Updated 5 years ago
- Collect, aggregate, and visualize a data ecosystem's metadata☆1,898Updated last week
- [NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis☆1,484Updated 2 years ago
- Concurrent data pipelines in Python >>>☆1,574Updated last year
- re_data - fix data issues before your users & CEO would discover them 😊☆1,563Updated 11 months ago
- NumPy and Pandas interface to Big Data☆3,199Updated last year
- Open Source Self-Hosted Business Intelligence Platform☆1,098Updated 2 years ago
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,277Updated this week