bloomberg / apache-spark-on-k8sLinks
Apache Spark enhanced with native Kubernetes scheduler back-end
☆15Updated 2 years ago
Alternatives and similar repositories for apache-spark-on-k8s
Users that are interested in apache-spark-on-k8s are comparing it to the libraries listed below
Sorting:
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 9 months ago
- Airflow workflow management platform chef cookbook.☆70Updated 6 years ago
- A facebook for data☆26Updated 6 years ago
- The sane way of building a data layer in Airflow☆24Updated 6 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆80Updated this week
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆37Updated 5 years ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- REST-like API exposing Airflow data and operations☆61Updated 7 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated last week
- Dremio Flight connector. Access Dremio using Arrow flight☆39Updated 5 years ago
- Apache Airflow CI pipeline☆19Updated 6 years ago
- Skeleton project for Apache Airflow training participants to work on.☆17Updated 5 years ago
- An example PySpark project with pytest☆17Updated 8 years ago
- event-triggered plugins for airflow☆21Updated 6 years ago
- ☆54Updated 8 years ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆160Updated 3 years ago
- Prometheus Exporter for Airflow☆161Updated last year
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 4 months ago
- This repository contains recipes for Apache Pinot.☆32Updated 11 months ago
- Aiven's S3 Sink Connector for Apache Kafka®☆71Updated last year
- ☆10Updated 3 years ago
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆160Updated last week
- A Giter8 template for scio☆31Updated 2 months ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 5 years ago
- Ansible playbooks for Apache Spark on kube☆27Updated 8 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Updated 2 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆52Updated 7 months ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 5 years ago
- Demos of Materialize, the operational data warehouse.☆52Updated 10 months ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago