arpit-mittal-ds / Data-Architect

Related projects ⓘ

Alternatives and complementary repositories for Data-Architect

• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated last year
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆92Updated 3 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• SatadruMukherjee / Data-Preprocessing-Models
  ☆60Updated 2 weeks ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated 11 months ago
• cloudxlab / bigdata
  This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.
  ☆42Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆43Updated 5 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆21Updated last year
• aws-dojo / analytics
  code snippet for analytics sessions
  ☆33Updated 2 years ago
• ashiqimran / Big-Data-Projects
  All my projects on Big Data are provided
  ☆27Updated 7 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆59Updated last year
• osin-vladimir / architect_big_data_solutions_with_spark
  code, labs and lectures for the course
  ☆45Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated last year
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated last year
• CICIFLY / Data_Engineering_Project_Portfolio
  Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3
  ☆26Updated 3 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• tatwan / airflow-spark-aws-emr
  ☆11Updated 3 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆42Updated last year
• kroudir / Data-Engineer-Nanodegree-Projects-Udacity
  Projects done in the Data Engineer Nanodegree Program by Udacity.com
  ☆94Updated last year
• Amaguk2023 / Pyspark_Spotify_ETL
  Pyspark Spotify ETL
  ☆17Updated 3 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 5 months ago
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆37Updated last year
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆30Updated 2 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated 7 months ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆21Updated 2 years ago
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• Realsid / databricks-spark-certification
  Guide for databricks spark certification
  ☆58Updated 3 years ago