This repo contains commands that data engineers use in day to day work.
☆64Feb 4, 2023Updated 3 years ago
Alternatives and similar repositories for TowardsDataEngineering
Users that are interested in TowardsDataEngineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PySpark Cheatsheet☆36Jan 18, 2023Updated 3 years ago
- PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster☆498Oct 15, 2024Updated last year
- This repo is mostly created for pyspark and hive related interview questions.☆64Jan 6, 2026Updated 7 months ago
- Serious SQL is a Data With Danny virtual data apprenticeship program.☆22Sep 3, 2021Updated 4 years ago
- Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3☆34Feb 2, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This is an all-in-one repository for Data Engineers, ideal for beginners & interview preparation, which includes Python as the main Progr…☆33Mar 21, 2023Updated 3 years ago
- Big Data for Data Engineers Coursera Specialization from Yandex☆98Mar 15, 2023Updated 3 years ago
- ☆95Sep 14, 2022Updated 3 years ago
- Notas das aulas da Aceleração Dev #4 da DIO sobre Engenharia de Dados, ministrado pela Everis.☆13Feb 6, 2021Updated 5 years ago
- Data engineering interviews Q&A for data community by data community☆68Jun 7, 2020Updated 6 years ago
- ☆27Feb 2, 2018Updated 8 years ago
- Different ways to connect to storage in Azure Databricks☆11Jul 19, 2019Updated 7 years ago
- Case Study's from Danny Ma's Serious SQL Course☆19Aug 4, 2022Updated 4 years ago
- A complete record of my journey as a competitive programmer, over various platforms. Most of the questions are from Codeforces.com in C++…☆10Jun 6, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆19Nov 9, 2025Updated 9 months ago
- 🚑Android App for people of India during this Pandemic of Covid-19. During COVID-19, people living in societies and apartments may not be…☆16Jan 10, 2021Updated 5 years ago
- Fundamentals of Spark with Python (using PySpark), code examples☆365Oct 29, 2022Updated 3 years ago
- Data Engineering Bootcamp 2021☆13Aug 8, 2023Updated 3 years ago
- Link to SQL Bolt Lessons and Exercises☆11Oct 25, 2017Updated 8 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆51Aug 23, 2019Updated 7 years ago
- This sample demonstrates how to make a use of modules provided by Microsoft Azure File Service in Python.☆11Apr 21, 2021Updated 5 years ago
- ☆15Feb 4, 2023Updated 3 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆105Sep 26, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Jan 22, 2024Updated 2 years ago
- Data Science Learning Notes☆11Oct 18, 2023Updated 2 years ago
- This is the git repo for the tutorials I have done for Time Series Forecasting by Jason Brownlee☆11Dec 5, 2018Updated 7 years ago
- FireBase Auth app built to authenticate user via firebase using Email Id , Phone Number , Google , Facebook , Yahoo , Twitter , Github …☆17Jul 29, 2020Updated 6 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution☆19Aug 16, 2020Updated 6 years ago
- Data set and queries that I use in my Hive and Impala presentations. Slides are usually posted at slideshare.net/markgrover☆20May 19, 2014Updated 12 years ago
- For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…☆26Feb 9, 2021Updated 5 years ago
- Example setup for a Apache Airflow environment to allow for easy development and testing of DAGs using docker compose.☆11Aug 21, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Nov 28, 2022Updated 3 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- A tool to validate data, built around Apache Spark.☆101Aug 10, 2026Updated 2 weeks ago
- various scripts☆20Dec 16, 2022Updated 3 years ago
- ☆15Sep 14, 2021Updated 4 years ago
- Personal Data Engineering Projects☆1,031Feb 8, 2023Updated 3 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 5 years ago