Alternatives and similar repositories for etl-flatfile-airflow

Users that are interested in etl-flatfile-airflow are comparing it to the libraries listed below

• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 4 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆63Updated 2 years ago
• IremErturk / dtc-de-capstone-project
  ☆11Updated 3 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 11 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• MarcosMJD / ghcn-d
  Data Pipeline from the Global Historical Climatology Network DataSet
  ☆27Updated 2 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆22Updated 2 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• fonylew / simple-cloud-functions-to-bigquery
  Cloud Functions streaming insert to BigQuery (with Cloud Pub/Sub trigger). In this example, the function will make a REST API call to get…
  ☆28Updated last year
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 3 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆73Updated last year
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated 2 years ago
• coder2j / pyspark-tutorial
  PySpark Tutorial for Beginners - Practical Examples in Jupyter Notebook with Spark version 3.4.1. The tutorial covers various topics like…
  ☆124Updated last year
• VicenteYago / steam-data-engineering
  A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!
  ☆25Updated 2 years ago
• JesusAcuna / data-engineering-project
  ☆28Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆48Updated 5 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆84Updated 6 years ago
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆36Updated 2 years ago
• mharty3 / energy_data_capstone
  ☆35Updated 2 years ago
• sungchun12 / serverless-data-pipeline-gcp
  Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…
  ☆26Updated 6 years ago
• abulbasar / pyspark-examples
  Code examples on Apache Spark using python
  ☆106Updated 2 years ago
• GoogleCloudPlatform / cloud-composer-mssql-dataflow-bigquery
  This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQ…
  ☆19Updated last month
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• cnstlungu / postcard-company-datamart
  learning-by-doing data model built with dbt-core
  ☆14Updated 7 months ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆33Updated last year
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆37Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆41Updated last year