hussein-awala / spark-on-k8sView external linksLinks
A Python package to submit and manage Apache Spark applications on Kubernetes.
☆46Aug 9, 2025Updated 6 months ago
Alternatives and similar repositories for spark-on-k8s
Users that are interested in spark-on-k8s are comparing it to the libraries listed below
Sorting:
- Helm chart for Lakekeeper - a Rust Native Iceberg REST Catalog☆21Feb 2, 2026Updated 2 weeks ago
- A package to run DuckDB queries from Apache Airflow.☆20Jun 17, 2024Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated last year
- Delta Lake helper methods. No Spark dependency.☆22Jan 19, 2026Updated 3 weeks ago
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆28May 19, 2025Updated 8 months ago
- Authentication classes to be used with requests☆39Jun 18, 2024Updated last year
- spark-sight: Spark performance at a glance☆10Apr 6, 2023Updated 2 years ago
- Beyond Vibe Coding. Code, Planning, Documentation and Product Management agents.☆70Jun 16, 2025Updated 8 months ago
- Repository for the dbt Semantic Layer course☆11Nov 13, 2025Updated 3 months ago
- NUI helm chart to deploy on K8s☆15Nov 19, 2025Updated 2 months ago
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 2 years ago
- This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with …☆15Dec 27, 2023Updated 2 years ago
- ☆15Updated this week
- I will store here a bunch of home assignments that I got (without company names) and their solutions.☆12Feb 21, 2024Updated last year
- Crossplane upjet provider for Confluent Cloud: https://registry.terraform.io/providers/confluentinc/confluent/latest/docs☆13Jan 20, 2026Updated 3 weeks ago
- This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a Clic…☆12May 9, 2024Updated last year
- Develop, Operate and Collaborate on Data and Analytics☆10Updated this week
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆94May 9, 2025Updated 9 months ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 2 years ago
- Building a poor man's data lake: Exploring the Power of Polars and Delta Lake☆11Dec 6, 2025Updated 2 months ago
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Nov 18, 2025Updated 3 months ago
- dbt-databend adapter plugin☆10May 30, 2024Updated last year
- ☆12Updated this week
- Crane community Helm charts☆10Apr 25, 2024Updated last year
- Helm charts for Paralus☆14Jan 16, 2026Updated last month
- Apache Airflow Best Practices, published by Packt☆50Nov 4, 2024Updated last year
- The Paradise Papers dataset and guide from the International Consortium of Investigative Journalists (ICIJ)☆11Oct 25, 2024Updated last year
- Chotot Web Standards☆10Feb 2, 2026Updated 2 weeks ago
- Docker image wrapping pgmodeler/pgmodeler.☆11Nov 5, 2025Updated 3 months ago
- functionality on top of an RDF store while accounting for and exploiting the fundamental differences between graph storage and relation…☆12Feb 21, 2024Updated last year
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 2 years ago
- The ultimate Vim configuration: .vimrc (heavily customized, uncompromising and opinionated)☆10Mar 2, 2024Updated last year
- Delta lake and filesystem helper methods☆50Feb 29, 2024Updated last year
- ☆15Dec 11, 2023Updated 2 years ago
- Adaptive learning platform for physics concept built on ChatGPT knowledge.☆11May 7, 2025Updated 9 months ago
- X Tools for Claude MCP: A lightweight toolkit enabling Claude to search Twitter with natural language and display results based on user i…☆16Mar 25, 2025Updated 10 months ago
- dlt-dagster-demo☆13Nov 6, 2023Updated 2 years ago
- Package contenant des nomenclatures et classifications pour le pmsi☆13May 5, 2025Updated 9 months ago