Alternatives and similar repositories for etl-flatfile-airflow:

Users that are interested in etl-flatfile-airflow are comparing it to the libraries listed below

• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆21Updated 2 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• IremErturk / dtc-de-capstone-project
  ☆11Updated 2 years ago
• mharty3 / energy_data_capstone
  ☆33Updated last year
• GoogleCloudPlatform / cloud-composer-mssql-dataflow-bigquery
  This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQ…
  ☆18Updated 10 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 8 months ago
• fonylew / simple-cloud-functions-to-bigquery
  Cloud Functions streaming insert to BigQuery (with Cloud Pub/Sub trigger). In this example, the function will make a REST API call to get…
  ☆27Updated last year
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆35Updated last year
• sungchun12 / serverless-data-pipeline-gcp
  Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…
  ☆26Updated 5 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated last year
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆25Updated last year
• muhammetbektas / spark_clickhouse_streaming
  Realtime Data Engineering Project
  ☆27Updated 2 months ago
• alexandraabbas / apache-airflow-course
  Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.
  ☆63Updated 4 years ago
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated 2 years ago
• cnstlungu / postcard-company-datamart
  learning-by-doing data model built with dbt-core
  ☆11Updated 3 months ago
• diljeet1994 / Python_Tutorials
  Python Notes on IPython Notebook files.
  ☆37Updated 4 years ago
• ksalama / datalab-notebooks
  This repository includes end-to-end labs on how to use GCP for applied data science
  ☆14Updated 6 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆23Updated 9 months ago
• dataform-co / dataform-example-project-bigquery
  ☆35Updated 3 months ago
• andrejnevesjr / airflow-spark-minio-postgres
  Project with Airflow + Spark + MinIO + Postgres + Python3.8
  ☆23Updated 2 years ago
• moontucer / Data-Streaming-Project
  used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline
  ☆27Updated last year
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• PacktPublishing / Data-Engineering-with-Google-Cloud-Platform
  Data Engineering with Google Cloud Platform, published by Packt
  ☆114Updated last year
• kaantas / spark-twitter-sentiment-analysis
  Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
  ☆55Updated 6 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆45Updated 5 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆82Updated 5 years ago
• pchrabka / PySpark-PyData
  ☆44Updated last year
• MarcosMJD / ghcn-d
  Data Pipeline from the Global Historical Climatology Network DataSet
  ☆27Updated 2 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago