delta-io / kafka-delta-ingest

Related projects ⓘ

Alternatives and complementary repositories for kafka-delta-ingest

• lakekeeper / lakekeeper
  Lakekeeper: A Rust native Iceberg REST Catalog
  ☆217Updated this week
• delta-incubator / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆143Updated this week
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆816Updated this week
• apache / iceberg-python
  Apache PyIceberg
  ☆461Updated this week
• projectnessie / nessie
  Nessie: Transactional Catalog for Data Lakes with Git-like semantics
  ☆1,031Updated this week
• memiiso / debezium-server-iceberg
  Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)
  ☆191Updated this week
• dataflint / spark
  Performance Observability for Apache Spark
  ☆192Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆162Updated this week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆342Updated 5 months ago
• bitsondatadev / trino-getting-started
  ☆252Updated 2 weeks ago
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆400Updated this week
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆83Updated 7 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆195Updated this week
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆213Updated this week
• delta-io / delta-sharing
  An open protocol for secure data sharing
  ☆769Updated this week
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆306Updated this week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆304Updated 2 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated last month
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆90Updated last week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆74Updated last month
• duckdb / duckdb_iceberg
  ☆150Updated 3 weeks ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆216Updated this week
• sutoiku / puffin
  Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg
  ☆303Updated last year
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆317Updated this week
• apache / polaris
  Apache Polaris, the interoperable, open source catalog for Apache Iceberg
  ☆1,129Updated this week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆187Updated last week