marcelonyc / igz_sparkk8sLinks
MLOps NYC 2019 training session: Runnign Spark on Kubernetes
☆18Updated 3 years ago
Alternatives and similar repositories for igz_sparkk8s
Users that are interested in igz_sparkk8s are comparing it to the libraries listed below
Sorting:
- Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.☆38Updated 3 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 3 years ago
- spark on kubernetes☆104Updated 2 years ago
- Build DataOps platform with Apache Airflow and dbt on AWS☆59Updated 4 years ago
- Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with …☆52Updated 9 months ago
- Big Data Demystified meetup and blog examples☆31Updated last year
- A repository of examples for Elyra (https://github.com/elyra-ai/elyra)☆86Updated 9 months ago
- This is the starter code for both the course and the project for Data Streaming with Spark☆16Updated 3 years ago
- Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR☆17Updated 5 months ago
- KubeFlow on AWS☆186Updated 3 weeks ago
- dbt / Amazon Redshift Demonstration Project☆34Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated last year
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 3 years ago
- Machine Learning Projects with Flytekit☆36Updated 2 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆182Updated 3 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 9 months ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆116Updated 3 months ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆25Updated 2 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- MLOps on Amazon EKS☆102Updated 2 weeks ago
- This repository shows a sample example to build, manage and orchestrate Machine Learning workflows using Amazon Sagemaker and Apache Airf…☆138Updated 4 years ago
- Train and Deploy Machine Learning Models on Kubernetes using Amazon EKS☆169Updated 6 years ago
- Open innovation with 60 minute cloud experiments on AWS☆88Updated last year
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆28Updated 5 years ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- ☆19Updated 4 years ago
- Feast AWS guide using Redshift / Spectrum / DynamoDB to build a credit scoring model☆67Updated 3 years ago
- ☆103Updated 9 months ago
- Run EMR workloads on EKS☆13Updated 4 years ago