A Python package to submit and manage Apache Spark applications on Kubernetes.
☆47Feb 27, 2026Updated 6 months ago
Alternatives and similar repositories for spark-on-k8s
Users that are interested in spark-on-k8s are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A package to run DuckDB queries from Apache Airflow.☆21Jun 17, 2024Updated 2 years ago
- An example of SparkConnect extension.☆15Mar 5, 2024Updated 2 years ago
- ☆10Jun 29, 2021Updated 5 years ago
- ☆10May 5, 2022Updated 4 years ago
- MCP Server for Apache Airflow☆33Oct 14, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated 2 years ago
- ☆18Aug 16, 2026Updated 2 weeks ago
- Terraform module for Cloudera Manager☆11May 6, 2020Updated 6 years ago
- Spark batch converter to convert AWS S3 server side logs to Parquet file format☆11Mar 24, 2023Updated 3 years ago
- Tradução do livro "Snake Wrangling for Kids" - Domando Serpentes para Crianças☆11Nov 27, 2013Updated 12 years ago
- Modular chatbot solution integrating Ollama, Open-WebUI, LiteLLM and AWS Bedrock, with on-premises, hybrid, AWS and Kubernetes deployment…☆17Feb 3, 2026Updated 6 months ago
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆96May 11, 2026Updated 3 months ago
- Dockerfile for OpenLogReplicator☆21Mar 3, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Helm chart for Lakekeeper - a Rust Native Iceberg REST Catalog☆25Updated this week
- Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail…☆14Jul 12, 2026Updated last month
- Delta Lake helper methods. No Spark dependency.☆21Jan 19, 2026Updated 7 months ago
- Building a real-time alert monitoring pipeline that sends email notifications off of Azure Event Hubs, Azure Databricks, and a Azure Logi…☆13Mar 8, 2020Updated 6 years ago
- ☆13Feb 19, 2025Updated last year
- Sons da CPI - Luide Matos☆19Jun 24, 2021Updated 5 years ago
- ☆24Aug 24, 2026Updated last week
- ☆13May 11, 2025Updated last year
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆28May 19, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Improving predictions of Bayesian neural nets via local linearization, AISTATS 2021☆16Dec 30, 2022Updated 3 years ago
- ☆15Nov 16, 2023Updated 2 years ago
- The ultimate Vim configuration: .vimrc (heavily customized, uncompromising and opinionated)☆11Mar 2, 2024Updated 2 years ago
- In this small project we will predict the email that in which folder it will go in spam or primary.☆11Jul 5, 2016Updated 10 years ago
- This repo provides the Kubernetes Helm chart for deploying Pyspark Notebook.☆17Nov 16, 2022Updated 3 years ago
- Produces a suitable .gitlab-ci.yml file from a Golang TXT Template to work as input for a parent/child triggered GitLab CICD pipeline.☆11Updated this week
- A minimal seed template for an Apache Pekko in Scala☆15Updated this week
- functionality on top of an RDF store while accounting for and exploiting the fundamental differences between graph storage and relation…☆12Aug 19, 2026Updated last week
- Scalable Batch and Stream Data Processing☆30Aug 21, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆17Apr 2, 2024Updated 2 years ago
- dbt-databend adapter plugin☆10May 30, 2024Updated 2 years ago
- Annotate signal, timeseries, waveforms...☆10Aug 3, 2020Updated 6 years ago
- hive-phoenix-handler is a hive plug-in that can access Apache Phoenix table on HBase using HiveQL.☆10Aug 17, 2017Updated 9 years ago
- A short demo to introduce the polars dataframe library through a marimo notebook.☆25Jan 29, 2025Updated last year
- ☆18Jun 25, 2026Updated 2 months ago
- In this pattern, data records are ingested and then modified with simple transformations such as field level substitutions and data enric…☆14Nov 21, 2018Updated 7 years ago