bloomberg / apache-spark-on-k8sLinks
Apache Spark enhanced with native Kubernetes scheduler back-end
☆15Updated 2 years ago
Alternatives and similar repositories for apache-spark-on-k8s
Users that are interested in apache-spark-on-k8s are comparing it to the libraries listed below
Sorting:
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆38Updated 4 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆39Updated 4 years ago
- An example PySpark project with pytest☆17Updated 8 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 7 months ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- ☆10Updated 3 years ago
- Ansible playbooks for Apache Spark on kube☆27Updated 8 years ago
- Scala SDK for working with Snowplow enriched events in Spark, AWS Lambda, Flink et al.☆21Updated last year
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- This repository contains recipes for Apache Pinot.☆32Updated 8 months ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 2 months ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆60Updated 2 years ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago
- Utility functions for dbt projects running on Spark☆33Updated 2 weeks ago
- A toolset to streamline running spark python on EMR☆20Updated 9 years ago
- Code examples for the Introduction to Kubeflow course☆14Updated 4 years ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆159Updated 2 years ago
- A Giter8 template for scio☆31Updated this week
- Cloud Spanner Connector for Apache Spark☆17Updated 10 months ago
- A python wrapper for the KSQL REST API.☆158Updated 2 years ago
- Read Delta tables without any Spark☆47Updated last year
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated last week
- Experiments produced during an end of studies project (ETS, H2018)☆14Updated 7 years ago
- A Helm Chart for Apache Airflow☆14Updated 7 years ago
- Oozie Workflow to Airflow DAGs migration tool☆88Updated 8 months ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 4 years ago
- Skeleton project for Apache Airflow training participants to work on.☆17Updated 5 years ago
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆61Updated 3 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 4 years ago