Alternatives and similar repositories for etl-flatfile-airflow

Users that are interested in etl-flatfile-airflow are comparing it to the libraries listed below

• IremErturk / dtc-de-capstone-project
  ☆11Updated 3 years ago
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆21Updated 2 years ago
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆21Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• MarcosMJD / ghcn-d
  Data Pipeline from the Global Historical Climatology Network DataSet
  ☆27Updated 2 years ago
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 2 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆46Updated 5 years ago
• guoliveira / data-engineer-zoomcamp-project
  ☆38Updated 2 years ago
• judeleonard / Prescriber-ETL-data-pipeline
  An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS ap…
  ☆25Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 3 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• VicenteYago / steam-data-engineering
  A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!
  ☆25Updated 2 years ago
• kaburelabs / Data-Engineering-track-with-Python
  All Data Engineering notebooks from Datacamp course
  ☆115Updated 5 years ago
• hyunjoonbok / amazon-sagemaker
  End-to-End examples that show how to solve business problems using Amazon SageMaker and it's ML/DL algorithm.
  ☆17Updated last year
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆35Updated 2 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• mremreozan / SQL-BigQuery
  Hackerrank, Coursera, other studies
  ☆13Updated 3 years ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆22Updated 3 years ago
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆14Updated 3 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆84Updated 5 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• AndrejaCH / Movies-ETL
  For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…
  ☆27Updated 4 years ago
• moontucer / Data-Streaming-Project
  used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline
  ☆26Updated last year
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆60Updated last year
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆34Updated 5 years ago
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated 2 years ago
• shivampanicker / cicd_with_databricks
  ☆30Updated 5 months ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆35Updated last year
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago