mara / mara-pipelinesLinks
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
☆2,085Updated 2 years ago
Alternatives and similar repositories for mara-pipelines
Users that are interested in mara-pipelines are comparing it to the libraries listed below
Sorting:
- Extract Transform Load for Python 3.5+☆1,604Updated 2 years ago
- Python Extract Transform and Load Tables of Data☆1,304Updated 4 months ago
- Quilt is a data mesh for connecting people with actionable data☆1,356Updated last week
- This repository is a getting started guide to Singer.☆1,322Updated 4 months ago
- Extract, Transform, Load: Any SQL Database in 4 lines of Code.☆556Updated 6 years ago
- Data Migration for the Blaze Project☆1,005Updated 3 years ago
- Writes the Singer format from Python☆575Updated 2 months ago
- ETL best practices with airflow, with examples☆1,353Updated last year
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,539Updated last year
- Template Language for SQL with Automatic Bind Parameter Extraction☆842Updated last year
- Data Pipeline Framework using the singer.io spec☆657Updated this week
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,760Updated last year
- Guides and docs to help you get up and running with Apache Airflow.☆815Updated last month
- Concurrent data pipelines in Python >>>☆1,592Updated 2 years ago
- Official repository for pygrametl - ETL programming in Python☆299Updated 3 months ago
- A curated list of awesome ETL frameworks, libraries, and software.☆3,504Updated last year
- Construct Apache Airflow DAGs Declaratively via YAML configuration files☆1,407Updated this week
- Pinball is a scalable workflow manager☆1,043Updated 6 years ago
- A Python stream processing engine modeled after Yahoo! Pipes☆1,602Updated 4 years ago
- A flexible python library for building your own cron-like system, with REST APIs and a Web UI.☆1,109Updated last year
- A docker image and kubernetes config files to run Airflow on Kubernetes☆656Updated 6 years ago
- Real-time stream processing for python☆1,289Updated last week
- Curated list of resources about Apache Airflow☆3,869Updated last year
- A curated list of data engineering tools for software developers☆494Updated 8 years ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆649Updated 2 weeks ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,713Updated last week
- Open Source Self-Hosted Business Intelligence Platform☆1,112Updated 2 weeks ago
- Python Fast Dataflow programming framework for Data pipeline work( Web Crawler,Machine Learning,Quantitative Trading.etc)☆1,202Updated 4 years ago
- This is a repo documenting the best practices in PySpark.☆462Updated 3 years ago
- CleverCSV is a Python package for handling messy CSV files. It provides a drop-in replacement for the builtin CSV module with improved di…☆1,317Updated 3 weeks ago