lealre / etl-airflow
An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.
☆22Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for etl-airflow
- Passo a passo para instalar no linux/wsl ubuntu☆9Updated 9 months ago
- O Excel Structure Validator é um projeto Python destinado a validar a estrutura de arquivos Excel.☆12Updated last year
- end-to-end data engineering project☆20Updated 9 months ago
- Found a data engineering challenge or participated in a selection process ? Share with us!☆62Updated 2 years ago
- ☆13Updated 10 months ago
- Sample project to demonstrate data engineering best practices☆164Updated 8 months ago
- workshop 03 - como montar um dw pagando pouco☆33Updated 10 months ago
- Data Engineering com Apache Spark☆43Updated 3 years ago
- Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase☆30Updated 3 months ago
- Pipeline ETL utilizando Pandera, pytest e CI☆9Updated 4 months ago
- The One Billion Row Challenge using Python☆71Updated 2 months ago
- Code for my "Efficient Data Processing in SQL" book.☆49Updated 3 months ago
- ☆99Updated 3 months ago
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆237Updated 3 months ago
- ☆14Updated 7 months ago
- Supplementary Materials for the The Complete dbt (Data Build Tool) Bootcamp Udemy course☆451Updated 2 weeks ago
- roadmap de engenharia de dados da jornada 2024☆293Updated this week
- Code for dbt tutorial☆143Updated 5 months ago
- Notebooks e dicas sobre Databricks☆19Updated this week
- Data pipeline to build a data warehouse on Postgres☆14Updated 2 months ago
- ☆126Updated last year
- Apartments Data Pipeline using Airflow and Spark.☆18Updated 2 years ago
- Sample repo for startdataengineering DE 101 free course☆35Updated 4 months ago
- ☆14Updated 2 weeks ago
- Code for "Advanced data transformations in SQL" free live workshop☆65Updated 2 weeks ago
- End to end data engineering project☆49Updated 2 years ago
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆16Updated last year
- Code for "Efficient Data Processing in Spark" Course☆239Updated last month
- Caso de uso com IA☆11Updated 6 months ago