KimaruThagna / ml-pipelines-airflowLinks
Demonstrating and Building ML pipelines in Airflow
☆11Updated 4 years ago
Alternatives and similar repositories for ml-pipelines-airflow
Users that are interested in ml-pipelines-airflow are comparing it to the libraries listed below
Sorting:
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 5 years ago
- Cost Efficient Data Pipelines with DuckDB☆58Updated 5 months ago
- New generation opensource data stack☆74Updated 3 years ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- Scaling Python Machine Learning☆50Updated 2 years ago
- Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with …☆52Updated 9 months ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- ☆27Updated 3 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Challenge Data Engineer☆25Updated 3 years ago
- Code snippets for Data Engineering Design Patterns book☆249Updated 7 months ago
- Data Engineering with Spark and Delta Lake☆104Updated 2 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated 2 years ago
- Feast AWS guide using Redshift / Spectrum / DynamoDB to build a credit scoring model☆67Updated 4 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated 2 years ago
- A Series of Notebooks on how to start with Kafka and Python☆152Updated 8 months ago
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆85Updated last year
- Demo assets for DAIS 2021 'Learn to use Databricks for the full ML lifecycle' Talk☆14Updated 4 years ago
- Cloned by the `dbt init` task☆62Updated last year
- ☆104Updated 9 months ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆77Updated this week
- A series of Jupyter notebooks that walk you through Machine Learning with Apache Spark ecosystem using Spark MLlib, PyTorch and TensorFlo…☆86Updated 2 years ago
- Data engineering with dbt, published by Packt☆87Updated 2 months ago
- Making Machine Learning Simple and Scalable with Python, Jupyter Notebook, TensorFlow, Keras, Apache Kafka and KSQL☆97Updated 6 years ago
- A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profil…☆90Updated last year
- The go to demo for public and private dbt Learn☆80Updated 7 months ago
- Duke MIDS: Data Engineering and DataOps Course☆67Updated 9 months ago
- ☆31Updated 4 years ago
- Delta Lake Documentation☆50Updated last year