danielbeach / polarsVpandasOnAwsLambda
Using Polars and Pandas on AWS Lambda to process data.
☆9Updated last year
Related projects ⓘ
Alternatives and complementary repositories for polarsVpandasOnAwsLambda
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆55Updated last year
- ☆15Updated 3 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆38Updated 2 weeks ago
- Full stack data engineering tools and infrastructure set-up☆44Updated 3 years ago
- Cost Efficient Data Pipelines with DuckDB☆47Updated 3 months ago
- csv and flat-file sniffer built in Rust.☆42Updated 9 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆48Updated last year
- rust-for-data☆43Updated last year
- ☆16Updated 6 months ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆14Updated 3 months ago
- Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it☆26Updated 8 months ago
- ☆24Updated 4 months ago
- A write-audit-publish implementation on a data lake without the JVM☆41Updated 3 months ago
- Code for my "Efficient Data Processing in SQL" book.☆50Updated 3 months ago
- Code snippets for Data Engineering Design Patterns book☆40Updated this week
- examples how to load data from different sources to weaviate☆15Updated last week
- ☆20Updated 3 years ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆24Updated 8 months ago
- Code for data quality with greatexpectations blog☆12Updated 3 months ago
- Demo on how to use Prefect 2 in an ML project☆40Updated 2 years ago
- ☆13Updated 9 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated last year
- ☆25Updated 2 years ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆149Updated 2 weeks ago
- ☆32Updated last year
- ☆9Updated 5 months ago
- Repo for CDC with debezium blog post☆26Updated 2 months ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆21Updated 2 months ago
- Step by step instructions to create a production-ready data pipeline☆27Updated last month
- Dask integration for Snowflake☆30Updated last week