bloomberg / apache-spark-on-k8s
Apache Spark enhanced with native Kubernetes scheduler back-end
☆16Updated last year
Alternatives and similar repositories for apache-spark-on-k8s:
Users that are interested in apache-spark-on-k8s are comparing it to the libraries listed below
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Ansible playbooks for Apache Spark on kube☆27Updated 7 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated last week
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 2 weeks ago
- An Ansible collection for lifecycle and management of Cloudera CDP Private Cloud resources on bare metal, IaaS, and PaaS.☆33Updated last month
- ☆28Updated 5 months ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- ☆13Updated last year
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- GitHub Action That Submits Argo Workflows For Execution on Your GKE Cluster☆16Updated 4 years ago
- Aiven's S3 Sink Connector for Apache Kafka®☆67Updated 5 months ago
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.☆28Updated 7 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆58Updated last year
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Updated 3 years ago
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆62Updated 2 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆62Updated 2 months ago
- ☆14Updated last week
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆38Updated 4 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Updated 6 years ago
- A kafka connect util☆12Updated 2 years ago
- 💻 CLI for reporting events to Faros platform☆14Updated 3 months ago
- ☆10Updated 2 years ago
- Deploy Presto on the cloud easily, using Terraform and Packer☆44Updated last year
- This repository contains recipes for Apache Pinot.☆29Updated 3 months ago
- Cloudbox Labs blog code☆35Updated 6 years ago