Alternatives and similar repositories for website:

Users that are interested in website are comparing it to the libraries listed below

• delta-io / delta-docs
  Delta Lake Documentation
  ☆48Updated 7 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated 11 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆222Updated last month
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆50Updated 11 months ago
• unitycatalog / unitycatalog-ui
  Unity Catalog UI
  ☆39Updated 4 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆214Updated 3 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆168Updated last week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆43Updated last year
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆37Updated last week
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated last year
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆50Updated 2 weeks ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated 10 months ago
• zheyuan28 / SparkTaskMetrics
  Task Metrics Explorer
  ☆13Updated 5 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 4 months ago
• jefflester / minitrino
  A tool that makes it easy to run modular Trino environments locally.
  ☆32Updated 2 months ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆29Updated 2 weeks ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆47Updated 10 months ago
• jamesshocking / collapse-spark-dataframe
  Python code that will collapse structured columns separating out the attributes into new columns
  ☆11Updated 2 years ago
• SemyonSinchenko / spark-connect-example
  An example of SparkConnect extension.
  ☆11Updated 10 months ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆76Updated 4 months ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆23Updated 7 months ago
• kevinjqliu / iceberg-rest-catalog
  Pythonic Iceberg REST Catalog
  ☆72Updated 4 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated 7 months ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 4 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆208Updated 2 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆192Updated this week
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆95Updated 2 weeks ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆70Updated 2 years ago