delta-io / kafka-delta-ingest

Related projects ⓘ

Alternatives and complementary repositories for kafka-delta-ingest

• lakekeeper / lakekeeper
  Lakekeeper: A Rust native Iceberg REST Catalog
  ☆235Updated this week
• apache / iceberg-python
  Apache PyIceberg
  ☆476Updated this week
• projectnessie / nessie
  Nessie: Transactional Catalog for Data Lakes with Git-like semantics
  ☆1,042Updated this week
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆146Updated this week
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆823Updated this week
• bitsondatadev / trino-getting-started
  ☆252Updated last month
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆196Updated 2 weeks ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆304Updated 2 months ago
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆312Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆248Updated 11 months ago
• delta-io / delta-sharing
  An open protocol for secure data sharing
  ☆771Updated last week
• memiiso / debezium-server-iceberg
  Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)
  ☆200Updated last week
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆406Updated 2 weeks ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆231Updated 4 months ago
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆217Updated this week
• apache / hudi-rs
  A native Rust library for Apache Hudi, with bindings into Python
  ☆147Updated this week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆342Updated 5 months ago
• dataflint / spark
  Performance Observability for Apache Spark
  ☆198Updated last week
• apache / iceberg-rust
  Apache Iceberg
  ☆670Updated this week
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆256Updated last month
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆189Updated this week
• sutoiku / puffin
  Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg
  ☆307Updated last year
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆84Updated 8 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆219Updated this week