noahgift / python-data-engineering-cookbookLinks
Some recipes for data engineering with Python
☆23Updated 4 years ago
Alternatives and similar repositories for python-data-engineering-cookbook
Users that are interested in python-data-engineering-cookbook are comparing it to the libraries listed below
Sorting:
- Duke MIDS: Data Engineering and DataOps Course☆66Updated 5 months ago
- Some recipes for doing with serverless technologies☆38Updated 5 months ago
- ☆35Updated 2 years ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆22Updated 3 years ago
- ☆28Updated last year
- Example repo to create end to end tests for data pipeline.☆25Updated last year
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Updated 4 years ago
- A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc☆13Updated 3 years ago
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆77Updated last year
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated 2 years ago
- Data Engineering with AWS Cookbook, published by Packt☆20Updated 6 months ago
- ☆87Updated 2 years ago
- ☆28Updated 3 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆48Updated 5 years ago
- Simple ETL pipeline using Python☆26Updated 2 years ago
- ☆65Updated last month
- Syllabus for Artificial Intelligence for Product Innovation Master of Engineering: https://ai.meng.duke.edu/degree☆32Updated 2 years ago
- Django-based course management platform for Zoomcamps☆67Updated this week
- Essential PySpark for Scalable Data Analytics, published by Packt☆45Updated 2 years ago
- End-to-end data engineer project☆19Updated last year
- ELT for AEMET weather data.☆14Updated 3 months ago
- Airflow 3 demos from DevRel☆65Updated last week
- Resources for the free AWS Data Engineering course on youtube☆101Updated 3 years ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆82Updated last month
- All the resources related to GenAI hands on workshop.☆22Updated 3 months ago
- This repo contains all the material developed during the 9-week bootcamp provided by DPhi in colaboration with DataTalks Club☆21Updated 2 years ago
- Step by step instructions to create a production-ready data pipeline☆52Updated 6 months ago