A Python package to submit and manage Apache Spark applications on Kubernetes.
☆47Feb 27, 2026Updated 7 months ago
Alternatives and similar repositories for spark-on-k8s
Users that are interested in spark-on-k8s are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A package to run DuckDB queries from Apache Airflow.☆21Jun 17, 2024Updated 2 years ago
- An example of SparkConnect extension.☆15Mar 5, 2024Updated 2 years ago
- ☆10Jun 29, 2021Updated 5 years ago
- ☆13Dec 5, 2025Updated 10 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Sep 11, 2026Updated last month
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated 5 months ago
- Dockerfile for OpenLogReplicator☆21Mar 3, 2026Updated 7 months ago
- Collection of Interesting Algorithms☆16Oct 13, 2020Updated 5 years ago
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated 2 months ago
- Delta Lake helper methods. No Spark dependency.☆21Jan 19, 2026Updated 8 months ago
- Building a real-time alert monitoring pipeline that sends email notifications off of Azure Event Hubs, Azure Databricks, and a Azure Logi…☆13Mar 8, 2020Updated 6 years ago
- ☆18Mar 24, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Feb 19, 2025Updated last year
- ☆13May 11, 2025Updated last year
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆28May 19, 2025Updated last year
- ☆15Nov 16, 2023Updated 2 years ago
- The ultimate Vim configuration: .vimrc (heavily customized, uncompromising and opinionated)☆11Mar 2, 2024Updated 2 years ago
- A JDBC streaming source for Spark☆10Feb 19, 2024Updated 2 years ago
- ☆16Jun 5, 2023Updated 3 years ago
- In this small project we will predict the email that in which folder it will go in spam or primary.☆11Jul 5, 2016Updated 10 years ago
- This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.☆17Nov 16, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A minimal seed template for an Apache Pekko in Scala☆15Oct 3, 2026Updated last week
- A tiny library to make writing CBV-based APIs easier in Django.☆12Aug 23, 2024Updated 2 years ago
- functionality on top of an RDF store while accounting for and exploiting the fundamental differences between graph storage and relation…☆12Aug 19, 2026Updated last month
- ☆17Apr 2, 2024Updated 2 years ago
- Annotate signal, timeseries, waveforms...☆10Aug 3, 2020Updated 6 years ago
- hive-phoenix-handler is a hive plug-in that can access Apache Phoenix table on HBase using HiveQL.☆10Aug 17, 2017Updated 9 years ago
- PySpark test helper methods with beautiful error messages☆776Updated this week
- Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps☆13Sep 30, 2021Updated 5 years ago
- Flake8 plugin to lint for backwards incompatible database migrations☆12Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The starter for Martin Tile Server☆15Jan 12, 2026Updated 9 months ago
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆31Jul 16, 2026Updated 2 months ago
- End to end data pipeline☆22Apr 13, 2025Updated last year
- Transfer.sh command line program, Now file sharing from the command line is easy.☆13Feb 28, 2023Updated 3 years ago
- An open-source project dedicated to constructing robust data pipelines and scalable software infrastructure. We leverage industry-standar…☆32May 27, 2024Updated 2 years ago
- ☆33Jul 2, 2026Updated 3 months ago
- Helm Chart for deploying Spark history server in Amazon EKS for S3 Spark Event Logs☆31Apr 4, 2026Updated 6 months ago