angelddaz / de-challenges
Project based learning for Data Engineering fundamentals.
☆13Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for de-challenges
- A repo to track data engineering projects☆13Updated 2 years ago
- Data engineering interviews Q&A for data community by data community☆61Updated 4 years ago
- Full stack data engineering tools and infrastructure set-up☆43Updated 3 years ago
- A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …☆18Updated 3 years ago
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆16Updated 6 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆13Updated 3 years ago
- pyspark dataframe made easy☆16Updated 2 years ago
- data engineering 100 days 🤖 🧲 🦾 | #DE☆37Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Apache Spark Guide☆29Updated 2 years ago
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆25Updated 2 years ago
- ☆19Updated 6 years ago
- Simple samples for writing ETL transform scripts in Python☆22Updated 3 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆14Updated 3 years ago
- Material for Talk Python Training course on Getting Started with Dask.☆28Updated last year
- This is a repository for the Duke University Cloud Computing course project on Serveless Data Engineering Pipeline. For this project, I r…☆19Updated 3 years ago
- datascienv is package that helps you to setup your environment in single line of code with all dependency and it is also include pyforest…☆58Updated 3 years ago
- Challenge Data Engineer☆25Updated 2 years ago
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆56Updated 2 years ago
- Challenge for those applying to the Software Engineer, Big Data position☆34Updated 13 years ago
- Template for Data Engineering and Data Pipeline projects☆104Updated last year
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- ETL with Python - Taught at DWH course 2017 (TAU)☆101Updated 7 years ago
- Simple ETL pipeline using Python☆20Updated last year
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- Example repo to create end to end tests for data pipeline.☆21Updated 4 months ago
- Code for my "Efficient Data Processing in SQL" book.☆49Updated 3 months ago
- Data Quest - Data Engineer Learning and Projects☆24Updated 5 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆85Updated 3 years ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆19Updated 4 years ago