priye-1 / airflow_data_pipeline

Related projects: ⓘ

• priye-1 / Real_time_End_to_End_Pipeline_using_Kafka
  ☆18Updated last year
• Sourav692 / Bigdata-Interview-Preparation-Guide
  ☆13Updated this week
• itversity / data-engineering-spark
  ☆84Updated 2 years ago
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆20Updated last year
• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆21Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated 10 months ago
• AnandDedha / aws-airflow-dataengineering-pipeline
  ☆16Updated 8 months ago
• sidharth1805 / Spotify_etl
  ☆123Updated last year
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated 4 months ago
• Amrit-Hub / Databricks-Certified-Data-Engineer-Associate-Questions
  This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.
  ☆69Updated last month
• shivampanicker / cicd_with_databricks
  ☆32Updated 9 months ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆91Updated last month
• PacktPublishing / Data-Engineering-with-AWS-2nd-edition
  Data Engineering with AWS, 2nd edition - Published by Packt
  ☆95Updated 10 months ago
• andrem8 / surf_dash
  ☆124Updated 2 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆93Updated 11 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆35Updated 2 months ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆57Updated 4 months ago
• Amrit-Hub / Databricks-Certified-Data-Engineer-Professional-Questions
  This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.
  ☆27Updated last month
• EdidiongEsu / capital_bikeshare
  ☆14Updated 5 months ago
• sparsh-ai / recohut
  Recohut - Learn data engineering, data science
  ☆93Updated last year
• SebasMBK / SunglassesHubETL
  This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process
  ☆44Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆39Updated 5 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆127Updated 4 years ago
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆26Updated last week
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆54Updated last month
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆156Updated 6 months ago
• raveendratal / PysparkRaveendra
  Git Repository
  ☆125Updated 11 months ago
• itversity / spark-sql-and-pyspark-using-python3
  Repository related to Spark SQL and Pyspark using Python3
  ☆36Updated 2 years ago
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆56Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆36Updated 11 months ago