feluelle / finance-data-builderLinks
Finance π¦ Data Builder π οΈ @ postgres π
β22Updated 4 years ago
Alternatives and similar repositories for finance-data-builder
Users that are interested in finance-data-builder are comparing it to the libraries listed below
Sorting:
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,β¦β90Updated 3 years ago
- A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.β31Updated last year
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for β¦β137Updated 5 years ago
- Cloned by the `dbt init` taskβ60Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatioβ¦β55Updated 2 years ago
- Data lake, data warehouse on GCPβ56Updated 3 years ago
- (project & tutorial) dag pipeline tests + ci/cd setupβ88Updated 4 years ago
- Execution of DBT models using Apache Airflow through Docker Composeβ117Updated 2 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.β29Updated last year
- Data engineering interviews Q&A for data community by data communityβ63Updated 5 years ago
- Code for dbt tutorialβ156Updated last month
- PySpark functions and utilities with examples. Assists ETL process of data modelingβ104Updated 4 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflowβ147Updated 5 years ago
- β18Updated 11 months ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as stagingβ¦β91Updated 5 years ago
- Spark data pipeline that processes movie ratings data.β29Updated 2 weeks ago
- Simple stream processing pipelineβ103Updated last year
- A complete development environment setup for working with Airflowβ128Updated 2 years ago
- Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' andΒ MLFlow'β121Updated 2 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.β14Updated 2 years ago
- Snowflake Cookbook, published by Packtβ80Updated 2 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)β120Updated 3 years ago
- A repo to track data engineering projectsβ13Updated 2 years ago
- Code snippets and tools published on the blog at lifearounddata.comβ12Updated 5 years ago
- Learn how to auto-ingest streaming data into Snowflake using Snowpipe.β23Updated 2 years ago
- Dockerizing an Apache Spark Standalone Clusterβ43Updated 3 years ago
- Classwork projects and home works done through Udacity data engineering nano degreeβ74Updated last year
- Full stack data engineering tools and infrastructure set-upβ53Updated 4 years ago
- Template for Data Engineering and Data Pipeline projectsβ112Updated 2 years ago
- A Series of Notebooks on how to start with Kafka and Pythonβ153Updated 4 months ago