arpit-mittal-ds / Data-Architect

Related projects: ⓘ

• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated last year
• itversity / data-engineering-spark
  ☆84Updated 2 years ago
• abhilash-1 / pyspark-project
  This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGG…
  ☆13Updated 2 years ago
• cloudxlab / bigdata
  This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.
  ☆42Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆20Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆39Updated 5 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 4 years ago
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆59Updated this week
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆58Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated last year
• itversity / spark-sql-and-pyspark-using-python3
  Repository related to Spark SQL and Pyspark using Python3
  ☆36Updated 2 years ago
• itversity / spark-sql
  Apache Spark using SQL
  ☆14Updated 3 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated 9 months ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆91Updated last month
• vighc / kafka-stream
  Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks
  ☆10Updated last year
• Sourav692 / Bigdata-Interview-Preparation-Guide
  ☆13Updated this week
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated 4 months ago
• K-G-PRAJWAL / Big-Data-Engineering
  ☆17Updated last year
• ashiqimran / Big-Data-Projects
  All my projects on Big Data are provided
  ☆27Updated 7 years ago
• CICIFLY / Data_Engineering_Project_Portfolio
  Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3
  ☆22Updated 3 years ago
• mohanakrishnavh / PySpark-Tutorial
  ☆19Updated 6 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 3 months ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 4 years ago
• shabie / streaming_nd
  Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions
  ☆16Updated last year
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆20Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆120Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated 10 months ago
• itversity / mastering-postgresql
  Content related to Mastering Postgresql along with videos.
  ☆14Updated 3 years ago