danielbeach / sniffer

Related projects: ⓘ

• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆22Updated 5 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆27Updated this week
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆45Updated last year
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆42Updated last month
• PedramNavid / rust-for-data
  rust-for-data
  ☆42Updated last year
• mrjsj / delta-lake-explorer
  ☆22Updated 2 months ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆47Updated last month
• sspaeti-com / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆38Updated 3 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆35Updated 6 months ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆156Updated this week
• delta-io / delta-docs
  Delta Lake Documentation
  ☆45Updated 3 months ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆30Updated 10 months ago
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆68Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆52Updated 5 months ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated 3 months ago
• borjavb / dbt-iceberg-poc
  ☆45Updated last month
• franloza / coches-net-dashboard
  Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market
  ☆52Updated last year
• mehd-io / pypi-duck-flow
  end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence
  ☆122Updated last week
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆41Updated 2 months ago
• mattmartin14 / dream_machine
  ☆36Updated 2 weeks ago
• EcZachly-Inc-Second-Boot-Camp / 7-llm-driven-data-engineering
  This is a public repository to go over all the LLM-driven data engineering concepts.
  ☆67Updated 11 months ago
• josephmachado / simple_polars_etl
  ☆15Updated 4 months ago
• dlt-hub / verified-sources
  Contribute to dlt verified sources 🔥
  ☆64Updated this week
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆36Updated 7 months ago
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆72Updated 2 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆185Updated this week
• delta-incubator / dat
  Delta Acceptance Testing
  ☆19Updated last month
• delta-io / delta-examples
  Delta Lake examples
  ☆201Updated 3 months ago
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated 10 months ago
• jonathanneo / data-aware-orchestration
  Data-aware orchestration with dagster, dbt, and airbyte
  ☆29Updated last year