vastevenson / vs-airflow-demoLinks
☆10Updated 3 years ago
Alternatives and similar repositories for vs-airflow-demo
Users that are interested in vs-airflow-demo are comparing it to the libraries listed below
Sorting:
- Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)☆304Updated last year
- Fully dockerized Data Warehouse (DWH) using Airflow, dbt, PostgreSQL and dashboard using redash☆24Updated 2 years ago
- ☆38Updated 2 years ago
- Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.☆325Updated 3 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆176Updated 3 years ago
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆506Updated 2 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆139Updated last year
- Docker with Airflow and Spark standalone cluster☆256Updated last year
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆60Updated last year
- ☆87Updated 4 months ago
- This is the final project that after participated the Data Engineering Zoomcamp☆11Updated 3 years ago
- Processing TfL data for bike usage with Google Cloud Platform.☆45Updated 2 years ago
- Repository for Deploying multiple machine learning models for inference on AWS Lambda and Amazon EFS☆16Updated 3 years ago
- This is an example of a Containerized Flask Application that can deploy to many target environments including: AWS, GCP and Azure.☆410Updated 4 months ago
- The data science project used in my Datacamp course Unit Testing for Data Science in Python☆143Updated last year
- ☆21Updated last year
- Spark all the ETL Pipelines☆32Updated last year
- mlops template☆284Updated 4 months ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆35Updated last year
- ☆494Updated 4 years ago
- ☆25Updated 3 years ago
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆347Updated last year
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆262Updated 10 months ago
- Full Machine Learning Lifecycle using Airflow, MLflow, and AWS S3☆24Updated 2 years ago
- ☆143Updated 2 years ago
- Orchestration of data science models in Apache Airflow, scale-up with Celery Executor and deploying in multiple Docker containers☆31Updated 4 years ago
- Template for enterprise application using Dash frontend with Flask backend☆109Updated 4 years ago
- A simple FastAPI application.☆90Updated last year
- ☆150Updated 3 years ago
- Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker☆103Updated 3 years ago