krisnova / spark-cluster-api-operator
Use Kubernetes to autoscale your spark clusters.
☆10Updated 5 years ago
Alternatives and similar repositories for spark-cluster-api-operator:
Users that are interested in spark-cluster-api-operator are comparing it to the libraries listed below
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Minikube for big data with Scala and Spark☆15Updated 5 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- Make your libraries magically appear in Databricks.☆47Updated last year
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated 11 months ago
- Ephemeral Hadoop clusters using Google Compute Platform☆135Updated 2 years ago
- ☆54Updated 7 years ago
- An umbrella project for multiple implementations of model serving☆46Updated 7 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 5 months ago
- API for reading and writing data via various file transfer protocols from Apache Spark.☆21Updated 4 years ago
- Lenses.io JDBC driver for Apache Kafka☆20Updated 3 years ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- ☆67Updated 6 years ago
- Flowchart for debugging Spark applications☆104Updated 4 months ago
- A giter8 template for Spark SBT projects☆72Updated 3 years ago
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 6 years ago
- A Scala framework to build derived datasets, aka batch views, of Telemetry data.☆34Updated 2 years ago
- AMQP data source for dstream (Spark Streaming)☆26Updated 2 years ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- Basic framework utilities to quickly start writing production ready Apache Spark applications☆35Updated 2 months ago
- A full example of my blog post regarding Sparks stateful streaming (http://asyncified.io/2016/07/31/exploring-stateful-streaming-with-apa…☆34Updated 7 years ago
- An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka☆27Updated last week
- A Spark metrics sink that pushes to InfluxDb☆51Updated 4 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 5 years ago
- Spark Scala docker container sample for AWS testing - EKS & S3☆24Updated 6 years ago
- Scala implementation of a credstash client☆10Updated 7 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 4 years ago
- Ansible playbooks for Apache Spark on kube☆27Updated 7 years ago
- ☆24Updated 4 years ago