mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
☆2,079Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for mara-pipelines
- Extract Transform Load for Python 3.5+☆1,587Updated last year
- Python Extract Transform and Load Tables of Data☆1,248Updated 5 months ago
- A curated list of awesome ETL frameworks, libraries, and software.☆3,279Updated 3 months ago
- Writes the Singer format from Python☆544Updated last month
- ETL best practices with airflow, with examples☆1,293Updated last month
- Template Language for SQL with Automatic Bind Parameter Extraction☆817Updated 6 months ago
- Data Migration for the Blaze Project☆1,004Updated 2 years ago
- This repository is a getting started guide to Singer.☆1,267Updated 2 months ago
- Quilt is a data mesh for connecting people with actionable data☆1,328Updated this week
- Curated list of resources about Apache Airflow☆3,681Updated 2 months ago
- Extract, Transform, Load: Any SQL Database in 4 lines of Code.☆554Updated 5 years ago
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,197Updated this week
- A Python stream processing engine modeled after Yahoo! Pipes☆1,604Updated 2 years ago
- Data Pipeline Framework using the singer.io spec☆639Updated this week
- Guides and docs to help you get up and running with Apache Airflow.☆799Updated 2 years ago
- Pinball is a scalable workflow manager☆1,047Updated 4 years ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,479Updated this week
- Python Stream Processing☆6,743Updated 3 months ago
- A docker image and kubernetes config files to run Airflow on Kubernetes☆654Updated 5 years ago
- A curated list of data engineering tools for software developers☆461Updated 7 years ago
- A Python data analysis library that is optimized for humans instead of machines.☆1,172Updated 3 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,550Updated 6 months ago
- Open Source Self-Hosted Business Intelligence Platform☆1,089Updated last year
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,680Updated 4 months ago
- Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.☆1,495Updated 3 months ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆621Updated this week
- sqldf for pandas☆1,341Updated 3 months ago
- Open Source Self-service Business Intelligence with Version Control☆319Updated last year
- Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.☆1,944Updated this week
- An example mini data warehouse for python project stats, template for new projects☆178Updated 4 years ago