mara / mara-pipelinesLinks
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
☆2,080Updated last year
Alternatives and similar repositories for mara-pipelines
Users that are interested in mara-pipelines are comparing it to the libraries listed below
Sorting:
- Extract Transform Load for Python 3.5+☆1,591Updated 2 years ago
- Python Extract Transform and Load Tables of Data☆1,270Updated last month
- ETL best practices with airflow, with examples☆1,333Updated 8 months ago
- Data Migration for the Blaze Project☆1,002Updated 2 years ago
- This repository is a getting started guide to Singer.☆1,303Updated 8 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,511Updated 6 months ago
- Extract, Transform, Load: Any SQL Database in 4 lines of Code.☆557Updated 6 years ago
- Concurrent data pipelines in Python >>>☆1,577Updated last year
- Writes the Singer format from Python☆562Updated 2 months ago
- A series of DAGs/Workflows to help maintain the operation of Airflow☆1,723Updated 11 months ago
- Real-time stream processing for python☆1,265Updated 6 months ago
- Data Pipeline Framework using the singer.io spec☆648Updated this week
- Quilt is a data mesh for connecting people with actionable data☆1,342Updated last week
- A curated list of awesome ETL frameworks, libraries, and software.☆3,405Updated 10 months ago
- Construct Apache Airflow DAGs Declaratively via YAML configuration files☆1,303Updated this week
- Template Language for SQL with Automatic Bind Parameter Extraction☆835Updated last year
- Guides and docs to help you get up and running with Apache Airflow.☆806Updated 2 years ago
- A docker image and kubernetes config files to run Airflow on Kubernetes☆655Updated 5 years ago
- Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting…☆4,580Updated 2 weeks ago
- Parsing and analysis of Vertica, Hive, and Presto SQL.☆1,080Updated 3 years ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆636Updated last month
- Pinball is a scalable workflow manager☆1,043Updated 5 years ago
- ☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️☆2,012Updated 4 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,561Updated last year
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,099Updated this week
- A Python stream processing engine modeled after Yahoo! Pipes☆1,601Updated 3 years ago
- A curated list of data engineering tools for software developers☆483Updated 7 years ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,376Updated 2 months ago
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,216Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,344Updated this week