jaumpedro214 / postsLinks
A list of all my posts and personal projects
☆73Updated last month
Alternatives and similar repositories for posts
Users that are interested in posts are comparing it to the libraries listed below
Sorting:
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆23Updated 3 years ago
- Hey this is the repo that has all the queries and data for my video game training series!☆154Updated 3 years ago
- ☆120Updated 4 months ago
- ☆36Updated 2 years ago
- ☆88Updated 3 years ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 6 years ago
- A tutorial for the Great Expectations library.☆73Updated 4 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆143Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆275Updated 8 months ago
- how to unit test your PySpark code☆29Updated 4 years ago
- I will attempt to create my own spotify wrapped by collecting data from the spotify API, perform transformations and create informative d…☆74Updated 2 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆64Updated 2 years ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆56Updated 2 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- build dw with dbt☆49Updated last year
- ☆28Updated 3 years ago
- ☆44Updated last year
- Code for dbt tutorial☆165Updated 2 months ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated 2 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆88Updated 6 months ago
- Processing TfL data for bike usage with Google Cloud Platform.☆46Updated 3 years ago
- Data Engineering with Google Cloud Platform, published by Packt☆118Updated 2 years ago
- ☆192Updated 4 years ago
- Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.☆230Updated 3 years ago
- ☆92Updated 2 years ago
- A Series of Notebooks on how to start with Kafka and Python☆152Updated 9 months ago
- An example MLFlow project☆49Updated 10 months ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆182Updated 3 years ago
- A series of Jupyter notebooks that walk you through Machine Learning with Apache Spark ecosystem using Spark MLlib, PyTorch and TensorFlo…☆86Updated 2 years ago
- DataTalks Workshop Materials☆19Updated last year