angelddaz / de-challengesLinks
Project based learning for Data Engineering fundamentals.
☆13Updated 4 years ago
Alternatives and similar repositories for de-challenges
Users that are interested in de-challenges are comparing it to the libraries listed below
Sorting:
- pyspark dataframe made easy☆16Updated 3 years ago
- A repo to track data engineering projects☆13Updated 2 years ago
- Data engineering interviews Q&A for data community by data community☆63Updated 5 years ago
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆28Updated 3 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆13Updated 3 years ago
- Apache Spark Guide☆31Updated 3 years ago
- ☆18Updated 7 years ago
- ☆15Updated 3 years ago
- Big Data Demystified meetup and blog examples☆31Updated 11 months ago
- Serverless ETL and Analytics with AWS Glue, published by Packt☆50Updated last year
- Material for Talk Python Training course on Getting Started with Dask.☆28Updated 2 years ago
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆137Updated 5 years ago
- This repo will guide you step-by-step method to create star schema dimensional model.☆25Updated 4 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …☆20Updated 3 years ago
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆18Updated 6 years ago
- Code for my "Efficient Data Processing in SQL" book.☆57Updated 11 months ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆38Updated last year
- ☆10Updated 4 years ago
- Simple ETL pipeline using Python☆26Updated 2 years ago
- My solutions for the Udacity Data Engineering Nanodegree☆34Updated 5 years ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆91Updated 5 years ago
- This repo is meant to make it really easy to analyze the interplays between health and social media use.☆44Updated 3 years ago
- Skeleton project for Apache Airflow training participants to work on.☆16Updated 5 years ago
- Snowflake Cookbook, published by Packt☆80Updated 2 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level …☆44Updated 4 years ago
- ☆29Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago