jaumpedro214 / postsLinks
A list of all my posts and personal projects
☆74Updated last year
Alternatives and similar repositories for posts
Users that are interested in posts are comparing it to the libraries listed below
Sorting:
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆24Updated 3 years ago
- ☆35Updated 2 years ago
- ☆44Updated last year
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆142Updated 2 years ago
- ☆88Updated 2 years ago
- Duke MIDS: Data Engineering and DataOps Course☆67Updated 7 months ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 6 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated last year
- An example MLFlow project☆48Updated 7 months ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆63Updated 2 years ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆55Updated last year
- Streamlit application to explore Snowflake Tables☆46Updated last year
- Data Engineering with AWS, 2nd edition - Published by Packt☆150Updated last year
- ☆187Updated 4 years ago
- ☆119Updated last month
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆102Updated 5 months ago
- Hey this is the repo that has all the queries and data for my video game training series!☆151Updated 3 years ago
- Essential PySpark for Scalable Data Analytics, published by Packt☆45Updated 2 years ago
- Code for dbt tutorial☆159Updated 3 months ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- DataTalks Workshop Materials☆19Updated last year
- ☆29Updated last year
- ☆30Updated 8 months ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- ☆142Updated 2 years ago
- Code for my "Efficient Data Processing in SQL" book.☆58Updated last year
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆85Updated last year
- Delta-Lake, ETL, Spark, Airflow☆48Updated 2 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆84Updated 4 months ago