dgadiraju / etl-demo

Related projects ⓘ

Alternatives and complementary repositories for etl-demo

• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated 7 months ago
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆12Updated 2 years ago
• AnandDedha / aws-airflow-dataengineering-pipeline
  ☆18Updated 10 months ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 5 months ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• itversity / spark-sql
  Apache Spark using SQL
  ☆14Updated 3 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆21Updated last year
• SatadruMukherjee / Data-Preprocessing-Models
  ☆60Updated 2 weeks ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆37Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated last year
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 3 years ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆67Updated last month
• priye-1 / airflow_data_pipeline
  ☆16Updated last year
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆30Updated 2 years ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆70Updated 6 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆51Updated 2 years ago
• hwang-db / db-common-assets
  To store quick starters for daily tasks on Databricks
  ☆34Updated 2 years ago
• siddd88 / snowflake-aws-udemy
  Course Material
  ☆22Updated last year
• itversity / mastering-python
  ☆15Updated 3 years ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆113Updated last month
• itversity / spark-sql-and-pyspark-using-python3
  Repository related to Spark SQL and Pyspark using Python3
  ☆36Updated 2 years ago
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆28Updated 2 months ago
• SomanathSankaran / spark_medium
  My Git Repo for Csv Data
  ☆19Updated 4 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated last year
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆59Updated last year