jaumpedro214 / postsLinks
A list of all my posts and personal projects
☆73Updated last year
Alternatives and similar repositories for posts
Users that are interested in posts are comparing it to the libraries listed below
Sorting:
- ☆41Updated last year
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆23Updated 3 years ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- Essential PySpark for Scalable Data Analytics, published by Packt☆45Updated 2 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- ☆35Updated 2 years ago
- Duke MIDS: Data Engineering and DataOps Course☆67Updated 6 months ago
- Streamlit application to explore Snowflake Tables☆43Updated last year
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆139Updated last year
- how to unit test your PySpark code☆29Updated 4 years ago
- Data Engineering with Google Cloud Platform, published by Packt☆119Updated last year
- ☆113Updated 3 years ago
- ☆87Updated 2 years ago
- ☆28Updated 3 years ago
- ☆39Updated 2 years ago
- A Series of Notebooks on how to start with Kafka and Python☆153Updated 4 months ago
- ☆186Updated 4 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆178Updated 3 years ago
- Code for my "Efficient Data Processing in SQL" book.☆57Updated 11 months ago
- Processing TfL data for bike usage with Google Cloud Platform.☆45Updated 3 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆74Updated last year
- Data Engineering with AWS, 2nd edition - Published by Packt☆151Updated last year
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated last year
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 6 years ago
- Code for dbt tutorial☆158Updated last month
- Project for real-time anomaly detection using Kafka and python☆58Updated 2 years ago
- Udacity Data Streaming Nanodegree Program☆22Updated 4 years ago
- ☆134Updated 5 months ago
- Example repo to kickstart integration with mlflow pipelines.☆77Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago