hussein-awala / spark-on-k8s

Related projects ⓘ

Alternatives and complementary repositories for spark-on-k8s

• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆84Updated 8 months ago
• mdesmet / trino-iceberg-maintenance
  ☆12Updated last year
• conveyordata / data-product-portal
  Data product portal created by Dataminded
  ☆148Updated this week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆189Updated this week
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆217Updated this week
• CreativeDataEU / PowerBITrinoConnector
  A Micosoft Power BI Custom Connector allowing you to import Trino data into Power BI.
  ☆50Updated last week
• delta-io / delta-examples
  Delta Lake examples
  ☆208Updated last month
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆137Updated this week
• getindata / kafka-connect-iceberg-sink
  ☆78Updated last year
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆46Updated 8 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆304Updated 2 months ago
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆196Updated this week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆196Updated 2 weeks ago
• starburstdata / dbt-trino-utils
  Utility functions for dbt projects running on Trino
  ☆20Updated 11 months ago
• bitsondatadev / trino-getting-started
  ☆252Updated last month
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• dataflint / spark
  Performance Observability for Apache Spark
  ☆198Updated this week
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆165Updated last week
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆70Updated 3 years ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆159Updated 3 weeks ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆111Updated this week
• trinodb / charts
  ☆151Updated this week
• leehuwuj / olh
  Open source stack lakehouse
  ☆25Updated 8 months ago