tanthml / spark_bazel
Spark Application with Bazel
☆15Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for spark_bazel
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- ETL script to migrate data from BigQuery to SQL.☆17Updated last month
- ☆21Updated 2 years ago
- A Giter8 template for scio☆30Updated 3 weeks ago
- Visualize dependencies between Airflow DAGs☆49Updated 3 years ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- Example to demonstrate using keras library via jep in scala☆15Updated 7 years ago
- Apache Spark docker container image (Standalone mode)☆35Updated 4 years ago
- Luigi with Kubernetes demo presented at Europython 2019 in Basel☆27Updated last year
- Apache Avro <-> pandas DataFrame☆135Updated 3 months ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 3 years ago
- ☆22Updated 3 weeks ago
- ☆74Updated 4 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 4 years ago
- Setting up Apache Airflow on GKE☆23Updated 6 years ago
- Skeleton project for Apache Airflow training participants to work on.☆16Updated 4 years ago
- A tool and library for easily deploying applications on Apache YARN☆142Updated 8 months ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Sample Faust project to process tweets in real-time☆13Updated 3 years ago
- Examples of Spark 3.0☆47Updated 4 years ago
- A tutorial on Apache Spark Unit Testing☆37Updated 8 years ago
- ☆24Updated 3 years ago
- Example of using Faust with Docker☆23Updated 5 years ago
- A simple hello world using Apache Spark☆25Updated 2 months ago
- Minikube for big data with Scala and Spark☆15Updated 5 years ago
- A guide to running Airflow on Kubernetes☆171Updated 5 years ago
- Utilities for writing tests that use Apache Spark.☆24Updated 5 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago