jaumpedro214 / postsLinks
A list of all my posts and personal projects
☆73Updated last year
Alternatives and similar repositories for posts
Users that are interested in posts are comparing it to the libraries listed below
Sorting:
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆24Updated 3 years ago
- ☆119Updated 3 weeks ago
- DataTalks Workshop Materials☆19Updated last year
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆141Updated 2 years ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- ☆35Updated 2 years ago
- Hey this is the repo that has all the queries and data for my video game training series!☆149Updated 3 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆76Updated last year
- ☆88Updated 2 years ago
- ☆186Updated 4 years ago
- how to unit test your PySpark code☆29Updated 4 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆63Updated 2 years ago
- ☆30Updated 7 months ago
- Duke MIDS: Data Engineering and DataOps Course☆67Updated 7 months ago
- Simple stream processing pipeline☆103Updated last year
- Essential PySpark for Scalable Data Analytics, published by Packt☆45Updated 2 years ago
- Mastering Big Data Analytics with PySpark, Published by Packt☆160Updated 11 months ago
- I will attempt to create my own spotify wrapped by collecting data from the spotify API, perform transformations and create informative d…☆74Updated 2 years ago
- Data Engineering with Google Cloud Platform, published by Packt☆118Updated last year
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- An end-to-end project on customer segmentation☆83Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆142Updated 4 months ago
- A Series of Notebooks on how to start with Kafka and Python☆153Updated 5 months ago
- Project for "Data pipeline design patterns" blog.☆45Updated last year
- Code for dbt tutorial☆159Updated 2 months ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 6 years ago
- Processing TfL data for bike usage with Google Cloud Platform.☆45Updated 3 years ago
- ☆28Updated 3 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆83Updated 3 months ago
- Streamlit application to explore Snowflake Tables☆44Updated last year