bloomberg / apache-spark-on-k8s
Apache Spark enhanced with native Kubernetes scheduler back-end
☆15Updated last year
Alternatives and similar repositories for apache-spark-on-k8s
Users that are interested in apache-spark-on-k8s are comparing it to the libraries listed below
Sorting:
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆39Updated 4 years ago
- Examples for High Performance Spark☆15Updated 6 months ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.☆28Updated 7 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated last month
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- Cloud Spanner Connector for Apache Spark☆17Updated 4 months ago
- Sketching data structures for scala, including t-digest☆15Updated 3 years ago
- Amundsen Gremlin☆21Updated 2 years ago
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Updated 6 years ago
- AWS bootstrap scripts for Mozilla's flavoured Spark setup.☆47Updated 5 years ago
- A Helm Chart for Apache Airflow☆14Updated 6 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆29Updated 2 weeks ago
- Ansible playbooks for Apache Spark on kube☆27Updated 7 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- ☆54Updated 7 years ago
- A Giter8 template for scio☆31Updated 3 months ago
- Spark to Tableau Extractor library☆18Updated 7 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- ☆22Updated 6 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated 6 months ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- A kafka connect util☆12Updated 2 years ago
- ☆10Updated 3 years ago
- ☆37Updated 5 years ago
- Fybrik platform - Arrow/Flight module☆16Updated 9 months ago
- Apache Airflow CI pipeline☆19Updated 5 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago