luatnc87 / robust-data-analytics-platform-with-duckdb-dbt-iceberg
Discover the simplicity and strength of Duckdb, dbt, and Iceberg in this project. Create an efficient, versatile data analytics solution for valuable insights.
☆32Updated last year
Related projects ⓘ
Alternatives and complementary repositories for robust-data-analytics-platform-with-duckdb-dbt-iceberg
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆111Updated last week
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆26Updated 8 months ago
- Query Snowflake tables locally with DuckDB, without any need for a running warehouse☆101Updated this week
- A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.☆22Updated last year
- This repo contains information about DuckDB extensions found on GitHub. Refreshed daily☆82Updated this week
- A Dagster plugin that allows you to run Meltano in Dagster☆43Updated 3 weeks ago
- A curated list of dagster code snippets for data engineers☆52Updated 8 months ago
- Integrates DuckDB with Google BigQuery, allowing direct querying and management of BigQuery datasets☆63Updated this week
- Alto is a versatile data integration tool that allows you to easily run Singer plugins, build and cache PEX files encapsulating those plu…☆56Updated last year
- Data Catalog for Databases and Data Warehouses☆31Updated 10 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated last year
- Sample code to accompany blog post showcasing Arrow Flight SQL running on DuckDB☆27Updated last year
- An experimental Athena extension for DuckDB 🐤☆50Updated 9 months ago
- A write-audit-publish implementation on a data lake without the JVM☆41Updated 3 months ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆24Updated 8 months ago
- CLI to create an ER Diagram from DuckDB database files☆71Updated 2 months ago
- Repo for orienting dbt users to the Dagster asset framework☆50Updated 2 years ago
- ☆10Updated last year
- dbt's adapter for dremio☆48Updated 2 years ago
- DuckDB Community Extension to prompt LLMs from SQL☆22Updated last week
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆37Updated this week
- Unity Catalog UI☆39Updated 2 months ago
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆27Updated last week
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆76Updated last week
- Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.☆39Updated 3 weeks ago
- Make simple storing test results and visualisation of these in a BI dashboard☆40Updated last week
- Delta reader for the Ray open-source toolkit for building ML applications☆43Updated 9 months ago
- dbt ksqlDB adapter☆27Updated 2 years ago
- Contribute to dlt verified sources 🔥☆72Updated 3 weeks ago
- Full stack data engineering tools and infrastructure set-up☆44Updated 3 years ago