mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
☆2,081Updated last year
Alternatives and similar repositories for mara-pipelines:
Users that are interested in mara-pipelines are comparing it to the libraries listed below
- Extract Transform Load for Python 3.5+☆1,589Updated last year
- ETL best practices with airflow, with examples☆1,313Updated 3 months ago
- Writes the Singer format from Python☆547Updated 3 months ago
- Python Extract Transform and Load Tables of Data☆1,254Updated 8 months ago
- Data Migration for the Blaze Project☆1,002Updated 2 years ago
- This repository is a getting started guide to Singer.☆1,282Updated 4 months ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,697Updated 7 months ago
- Pinball is a scalable workflow manager☆1,045Updated 5 years ago
- Template Language for SQL with Automatic Bind Parameter Extraction☆823Updated 9 months ago
- A curated list of awesome ETL frameworks, libraries, and software.☆3,319Updated 5 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,488Updated last month
- Guides and docs to help you get up and running with Apache Airflow.☆804Updated 2 years ago
- A Python stream processing engine modeled after Yahoo! Pipes☆1,605Updated 3 years ago
- Quilt is a data mesh for connecting people with actionable data☆1,329Updated this week
- Curated list of resources about Apache Airflow☆3,722Updated 4 months ago
- Automatically generate a RESTful API service for your legacy database. No code required!☆2,016Updated this week
- Data Pipeline Framework using the singer.io spec☆646Updated this week
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,231Updated this week
- Official repository for pygrametl - ETL programming in Python☆295Updated 2 months ago
- A docker image and kubernetes config files to run Airflow on Kubernetes☆655Updated 5 years ago
- [NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis☆1,487Updated 2 years ago
- Python Stream Processing☆6,757Updated 5 months ago
- Real-time stream processing for python☆1,251Updated last month
- A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.☆580Updated last year
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆626Updated this week
- Docker Apache Airflow☆3,790Updated last year
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,973Updated this week
- Open Source Self-Hosted Business Intelligence Platform☆1,090Updated 2 years ago
- Actively curated list of awesome BI tools. PRs welcome!☆2,115Updated 4 months ago