bloomberg / apache-spark-on-k8sLinks
Apache Spark enhanced with native Kubernetes scheduler back-end
☆15Updated 2 years ago
Alternatives and similar repositories for apache-spark-on-k8s
Users that are interested in apache-spark-on-k8s are comparing it to the libraries listed below
Sorting:
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆38Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated this week
- Dremio Flight connector. Access Dremio using Arrow flight☆39Updated 5 years ago
- pysh-db - The Data Science Toolkit (DSK)☆13Updated 7 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 8 months ago
- The sane way of building a data layer in Airflow☆24Updated 6 years ago
- Prometheus Exporter for Airflow☆161Updated last year
- Ansible playbooks for Apache Spark on kube☆27Updated 8 years ago
- Utility functions for dbt projects running on Spark☆34Updated last week
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- This repository contains recipes for Apache Pinot.☆32Updated 9 months ago
- Fybrik platform - Arrow/Flight module☆16Updated last year
- ☆25Updated 4 years ago
- Skeleton project for Apache Airflow training participants to work on.☆17Updated 5 years ago
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆61Updated 3 years ago
- dlt-dagster-demo☆13Updated 2 years ago
- ☆10Updated 3 years ago
- Oozie Workflow to Airflow DAGs migration tool☆88Updated last week
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆52Updated 5 months ago
- Read Delta tables without any Spark☆47Updated last year
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆85Updated last year
- ☆75Updated 9 months ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 months ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 2 months ago
- Herd-UI is a search and discovery tool for business and technical users. Everyone in your organization can use Herd-UI to browse and unde…☆16Updated 3 years ago
- dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.☆57Updated 3 years ago
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago