ttauveron / k8s-big-data-experiments
Experiments produced during an end of studies project (ETS, H2018)
☆15Updated 6 years ago
Alternatives and similar repositories for k8s-big-data-experiments:
Users that are interested in k8s-big-data-experiments are comparing it to the libraries listed below
- Cloud Spanner Connector for Apache Spark☆17Updated 3 months ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated 5 months ago
- Oozie Workflow to Airflow DAGs migration tool☆87Updated last month
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- A facebook for data☆26Updated 5 years ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated 3 months ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated last week
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Updated 3 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- A Giter8 template for scio☆31Updated 2 months ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- ☆10Updated 6 years ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- Apache Spark enhanced with native Kubernetes scheduler back-end☆15Updated last year
- event-triggered plugins for airflow☆21Updated 5 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- ☆10Updated 2 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆88Updated last year
- ☆63Updated 5 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- ☆54Updated 7 years ago
- Apache (Py)Spark type annotations (stub files).☆117Updated 2 years ago