jwills / de4mlLinks
Supporting materials/code examples for my course in data engineering for machine learning.
☆39Updated 3 years ago
Alternatives and similar repositories for de4ml
Users that are interested in de4ml are comparing it to the libraries listed below
Sorting:
- Linear regression in SQL using dbt☆75Updated 11 months ago
- Build your feature store with macros right within your dbt repository☆39Updated 2 years ago
- Fake Pandas / PySpark DataFrame creator☆48Updated last year
- A python library bakeoff for medium sized datasets☆24Updated 2 years ago
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆25Updated last year
- Playground for using large language models into the Modern Data Stack for entity matching☆108Updated 2 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆119Updated 4 months ago
- Dask integration for Snowflake☆30Updated 4 months ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- A serverless duckDB deployment at GCP☆41Updated 3 years ago
- [DEPRECATED] A dbt adapter for Excel.☆96Updated 8 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated 2 years ago
- ☆23Updated last year
- A playground for running duckdb as a stateless query engine over a data lake☆216Updated last year
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆81Updated last year
- Cost Efficient Data Pipelines with DuckDB☆60Updated 7 months ago
- ☆59Updated last year
- ☆92Updated last year
- ☆167Updated 6 months ago
- ☆85Updated 3 years ago
- The Modern Data Stack in a (Smaller) Box☆12Updated 2 years ago
- Write your dbt models using Ibis☆74Updated 8 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated last month
- Creates a Simulation of Fake Web Events☆85Updated 3 years ago
- Parse dbt artifacts and search dbt models with Algolia☆52Updated 4 years ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated 2 years ago
- An experimental Athena extension for DuckDB 🐤☆57Updated 11 months ago
- csv and flat-file sniffer built in Rust.☆43Updated last year
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆45Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year