krisnova / spark-cluster-api-operatorLinks
Use Kubernetes to autoscale your spark clusters.
☆10Updated 6 years ago
Alternatives and similar repositories for spark-cluster-api-operator
Users that are interested in spark-cluster-api-operator are comparing it to the libraries listed below
Sorting:
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- Terraform module for a PostgreSQL-backed Apache Airflow instance☆24Updated 7 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 4 years ago
- A Giter8 template for scio☆31Updated 4 months ago
- Minikube for big data with Scala and Spark☆15Updated 5 years ago
- ☆54Updated 7 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆69Updated 4 months ago
- A Spark metrics sink that pushes to InfluxDb☆51Updated 4 years ago
- Twitter Streaming API Example with Kafka Streams in Scala☆49Updated 8 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 9 months ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Updated 5 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆136Updated 3 years ago
- Sketching data structures for scala, including t-digest☆15Updated 3 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated 2 years ago
- A giter8 template for Spark SBT projects☆73Updated 4 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆112Updated 5 years ago
- An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka☆27Updated last month
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- A tutorial on Apache Spark Unit Testing☆37Updated 9 years ago
- ☆37Updated 6 years ago
- Spawns JupyterHub single user servers in Marathon☆11Updated 7 years ago
- ☆67Updated 6 years ago
- Lenses.io CLI (command-line interface)☆37Updated 7 months ago
- Spark on Kubernetes infrastructure Docker images repo☆37Updated 2 years ago
- Make your libraries magically appear in Databricks.☆47Updated last year
- Flowchart for debugging Spark applications☆105Updated 9 months ago