viaduct-ai / docker-spark-k8s-awsLinks
Docker image for running Spark 3 on Kubernetes on AWS
☆27Updated 4 years ago
Alternatives and similar repositories for docker-spark-k8s-aws
Users that are interested in docker-spark-k8s-aws are comparing it to the libraries listed below
Sorting:
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆222Updated 3 months ago
- Helm charts for Trino and Trino Gateway☆170Updated last week
- Examples and custom spark images for working with the spark-on-k8s operator on AWS☆26Updated 4 years ago
- The athena adapter plugin for dbt (https://getdbt.com)☆139Updated 2 years ago
- Utility functions for dbt projects running on Trino☆21Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago
- Performant Redshift data source for Apache Spark☆140Updated 2 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆99Updated 2 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago
- This repository contains the dbt-glue adapter☆124Updated last week
- The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…☆127Updated 2 weeks ago
- Adapter for dbt that executes dbt pipelines on Apache Flink☆95Updated last year
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆238Updated 2 weeks ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆165Updated 5 months ago
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆190Updated last week
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati …☆116Updated 7 months ago
- Spark ETL example processing New York taxi rides public dataset on EKS☆45Updated 2 years ago
- Helm Chart for deploying Spark history server in Amazon EKS for S3 Spark Event Logs☆21Updated last week
- ☆80Updated 2 months ago
- Spark runtime on AWS Lambda☆107Updated 9 months ago
- ☆12Updated 4 months ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆149Updated last week
- A repository of sample code to accompany our blog post on Airflow and dbt.☆173Updated last year
- Great Expectations Airflow operator☆166Updated this week
- Spark on Kubernetes infrastructure Helm charts repo☆203Updated 2 years ago
- Airflow support for Marquez☆32Updated 4 years ago
- Spark Structured Streaming Kinesis Data Streams connector supports both GetRecords and SubscribeToShard (Enhanced Fan-Out, EFO)☆35Updated last month
- A client for connecting and running DDLs on hive metastore.☆55Updated last year
- Apache Spark build compatible with AWS Glue Data Catalog.☆19Updated 3 years ago
- This project provides a reverse proxy for Spark UI on Kubernetes☆15Updated last year