mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
☆2,081Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for mara-pipelines
- Extract Transform Load for Python 3.5+☆1,588Updated last year
- Python Extract Transform and Load Tables of Data☆1,250Updated 6 months ago
- Quilt is a data mesh for connecting people with actionable data☆1,330Updated this week
- Data Migration for the Blaze Project☆1,004Updated 2 years ago
- Template Language for SQL with Automatic Bind Parameter Extraction☆821Updated 7 months ago
- ETL best practices with airflow, with examples☆1,295Updated last month
- A curated list of awesome ETL frameworks, libraries, and software.☆3,287Updated 3 months ago
- This repository is a getting started guide to Singer.☆1,272Updated 2 months ago
- Writes the Singer format from Python☆545Updated last month
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,481Updated this week
- Python Fast Dataflow programming framework for Data pipeline work( Web Crawler,Machine Learning,Quantitative Trading.etc)☆1,199Updated 3 years ago
- Real-time stream processing for python☆1,244Updated 5 months ago
- ☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️☆1,918Updated 2 weeks ago
- Lore makes machine learning approachable for Software Engineers and maintainable for Machine Learning Researchers☆1,550Updated last year
- Official repository for pygrametl - ETL programming in Python☆290Updated 3 weeks ago
- A Python stream processing engine modeled after Yahoo! Pipes☆1,604Updated 2 years ago
- Curated list of resources about Apache Airflow☆3,691Updated 3 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,552Updated 6 months ago
- A Python data analysis library that is optimized for humans instead of machines.☆1,173Updated 3 months ago
- Concurrent data pipelines in Python >>>☆1,549Updated last year
- Open Source Self-Hosted Business Intelligence Platform☆1,088Updated last year
- Guides and docs to help you get up and running with Apache Airflow.☆800Updated 2 years ago
- Python Stream Processing☆6,746Updated 3 months ago
- A docker image and kubernetes config files to run Airflow on Kubernetes☆655Updated 5 years ago
- Extract, Transform, Load: Any SQL Database in 4 lines of Code.☆554Updated 5 years ago
- Python library for building highly effective data science workflows☆952Updated last year
- Compare tables within or across databases☆2,945Updated 6 months ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆623Updated last week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,913Updated this week
- executable archive format☆1,576Updated 10 months ago