ajithshetty / data-engineering-rust-demo
Rust And Delta Demo. Explanation and walkthrough on delta-rs
☆9Updated last year
Related projects: ⓘ
- ☆22Updated 2 years ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆79Updated last month
- Delta reader for the Ray open-source toolkit for building ML applications☆40Updated 7 months ago
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated 3 months ago
- Mock streaming data generator☆14Updated 3 months ago
- Pythonic Iceberg REST Catalog☆60Updated last week
- Full stack data engineering tools and infrastructure set-up☆38Updated 3 years ago
- Demos of Materialize, the operational data warehouse.☆50Updated 2 weeks ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆24Updated 6 months ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆72Updated 2 months ago
- Data pipeline example written in Rust with Polars and DataFusion DataFrame package☆38Updated last year
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆22Updated last year
- ☆10Updated last year
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated 2 weeks ago
- ☆26Updated 3 months ago
- ☆21Updated 6 months ago
- csv and flat-file sniffer built in Rust.☆40Updated 7 months ago
- A collection of examples to demonstrate how to interact with Redpanda from various clients and languages.☆9Updated 8 months ago
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆9Updated 7 months ago
- A Table format agnostic data sharing framework☆36Updated 7 months ago
- Utility functions for dbt projects running on Spark☆30Updated 10 months ago
- ☆31Updated 6 months ago
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆61Updated last year
- A custom end-to-end data pipeline for customer churn☆9Updated this week
- Adapter for dbt that executes dbt pipelines on Apache Flink☆80Updated 6 months ago
- dbt adapter for Rockset☆15Updated 3 months ago
- Yet Another (Spark) ETL Framework☆18Updated 10 months ago
- A write-audit-publish implementation on a data lake without the JVM☆39Updated last month
- ☆11Updated last month
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆12Updated last year