ajithshetty / data-engineering-rust-demoLinks
Rust And Delta Demo. Explanation and walkthrough on delta-rs
☆10Updated 2 years ago
Alternatives and similar repositories for data-engineering-rust-demo
Users that are interested in data-engineering-rust-demo are comparing it to the libraries listed below
Sorting:
- Open, Multi-modal Catalog for Data & AI, written in Rust☆85Updated last year
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 9 months ago
- Yet Another (Spark) ETL Framework☆21Updated 2 years ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆30Updated last year
- dbt-databend adapter plugin☆10Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- DataOps Observability is part of DataKitchen's Open Source Data Observability. DataOps Observability monitors every data journey from da…☆50Updated last month
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated last year
- Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.☆169Updated 3 months ago
- Repo for CDC with debezium blog post☆29Updated last year
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Enables Python developers to leverage Debezium's CDC capabilities with custom event handlers and seamless integration.☆37Updated last week
- A Table format agnostic data sharing framework☆42Updated last year
- csv and flat-file sniffer built in Rust.☆44Updated last year
- ☆15Updated 2 years ago
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆61Updated 3 years ago
- Delta Lake helper methods. No Spark dependency.☆23Updated last year
- Adapter for dbt that executes dbt pipelines on Apache Flink☆96Updated last year
- Utility functions for dbt projects running on Spark☆34Updated last week
- Iceberg Playground in a Box☆67Updated 6 months ago
- Cost Efficient Data Pipelines with DuckDB☆60Updated 7 months ago
- A custom end-to-end analytics platform for customer churn☆11Updated 7 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated 2 years ago
- ☆16Updated last month
- A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino☆22Updated 3 years ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆80Updated this week
- ☆62Updated 7 months ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated last week
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆78Updated this week
- ☆30Updated last year