A Python package to submit and manage Apache Spark applications on Kubernetes.
☆47Feb 27, 2026Updated 5 months ago
Alternatives and similar repositories for spark-on-k8s
Users that are interested in spark-on-k8s are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A package to run DuckDB queries from Apache Airflow.☆21Jun 17, 2024Updated 2 years ago
- ☆13Dec 5, 2025Updated 8 months ago
- MCP Server for Apache Airflow☆33Oct 14, 2025Updated 9 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated last year
- ☆18Jul 20, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Example Flink and Kafka integration project☆15Nov 28, 2015Updated 10 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated 2 years ago
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated 3 months ago
- Helm chart for Lakekeeper - a Rust Native Iceberg REST Catalog☆25Updated this week
- Collection of Interesting Algorithms☆16Oct 13, 2020Updated 5 years ago
- Flink image for Kubernetes that fixes Jobmanage connection issue☆26Jul 31, 2018Updated 8 years ago
- Delta Lake helper methods. No Spark dependency.☆21Jan 19, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Building a real-time alert monitoring pipeline that sends email notifications off of Azure Event Hubs, Azure Databricks, and a Azure Logi…☆13Mar 8, 2020Updated 6 years ago
- ☆13Feb 19, 2025Updated last year
- A library that brings useful functions from various modern database management systems to Apache Spark☆63Sep 4, 2023Updated 2 years ago
- Postgresql configured to work as metastore for Hive.☆32Dec 16, 2022Updated 3 years ago
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆28May 19, 2025Updated last year
- spark-sight: Spark performance at a glance☆10Apr 6, 2023Updated 3 years ago
- ☆25Feb 7, 2024Updated 2 years ago
- HiveQL Jupyter Kernel☆10Aug 5, 2022Updated 4 years ago
- This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.☆17Nov 16, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A minimal seed template for an Apache Pekko in Scala☆15Updated this week
- Docker image wrapping pgmodeler/pgmodeler.☆11Nov 5, 2025Updated 9 months ago
- Develop, Operate and Collaborate on Data and Analytics☆10Feb 13, 2026Updated 5 months ago
- Scalable Batch and Stream Data Processing☆30Aug 21, 2024Updated last year
- ☆17Apr 2, 2024Updated 2 years ago
- dbt-databend adapter plugin☆10May 30, 2024Updated 2 years ago
- Update cookiecutter projects☆12Mar 30, 2021Updated 5 years ago
- hive-phoenix-handler is a hive plug-in that can access Apache Phoenix table on HBase using HiveQL.☆10Aug 17, 2017Updated 8 years ago
- PySpark test helper methods with beautiful error messages☆774Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps☆13Sep 30, 2021Updated 4 years ago
- Flake8 plugin to lint for backwards incompatible database migrations☆12Updated this week
- In this pattern, data records are ingested and then modified with simple transformations such as field level substitutions and data enric…☆14Nov 21, 2018Updated 7 years ago
- This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenario…☆30Jul 16, 2026Updated 3 weeks ago
- End to end data pipeline☆22Apr 13, 2025Updated last year
- Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.☆129Sep 7, 2018Updated 7 years ago
- A service which allows Hive Metastore Listeners to be deployed outside of the Hive Metastore Service☆13Jun 30, 2026Updated last month