liehendi11 / IFN645
Tutorial notes for IFN645
☆8Updated 6 years ago
Related projects: ⓘ
- Apache Beam starter repo for Python☆17Updated last week
- Cloud Dataproc: Samples and Utils☆198Updated last month
- ☆200Updated 2 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.☆38Updated 2 years ago
- ☆180Updated last year
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆369Updated 2 weeks ago
- GCP-Data-Engineer-Study-Guide☆117Updated 5 years ago
- ☆20Updated 6 years ago
- Airflow basics tutorial☆397Updated 3 years ago
- Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.☆44Updated 4 years ago
- Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks☆35Updated 3 years ago
- A docker-compose file for launching Jupyter Notebooks in a container.☆154Updated 6 years ago
- ☆54Updated last year
- How to build an awesome data engineering team☆99Updated 5 years ago
- Repo to migrate old wiki to, esp for devs and code examples☆185Updated 7 years ago
- This repository shows a sample example to build, manage and orchestrate Machine Learning workflows using Amazon Sagemaker and Apache Airf…☆137Updated 3 years ago
- Data Engineering on Google Cloud Platform☆361Updated last month
- Data Analytics Week at the AWS Loft☆48Updated 4 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated 10 months ago
- ☆42Updated 4 years ago
- ☆202Updated last year
- This repository contains code for Spark Streaming☆21Updated 3 years ago
- Set up a 3 node spark cluster using docker containers☆33Updated 6 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆184Updated 9 months ago
- CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer☆348Updated last week
- Cloud Dataproc: Samples and Utils☆11Updated 3 years ago
- Repo for all my code on the articles I post on medium☆105Updated last year
- A small example of reading and writing an AWS kinesis stream with python lambdas☆12Updated 6 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago