dogukannulu / csv_extract_airflow_dockerView external linksLinks
Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
☆38Sep 1, 2023Updated 2 years ago
Alternatives and similar repositories for csv_extract_airflow_docker
Users that are interested in csv_extract_airflow_docker are comparing it to the libraries listed below
Sorting:
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 2 years ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 2 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆144Jul 27, 2023Updated 2 years ago
- Docker Apache Airflow☆13Mar 1, 2023Updated 2 years ago
- This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.☆13Sep 5, 2024Updated last year
- ☆14May 11, 2025Updated 9 months ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Jul 21, 2023Updated 2 years ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 2 years ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated last year
- ☆19Feb 25, 2022Updated 3 years ago
- Tensorflow implementation of time series generation using a variational autoencoder☆26Aug 12, 2024Updated last year
- In this project I used ML modeling and data analysis to predict ad clicks and significantly improve ad campaign performance, resulting in…☆11Nov 6, 2023Updated 2 years ago
- ☆10Aug 6, 2024Updated last year
- Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase☆43Jul 19, 2024Updated last year
- A Python package extending pandas with helper functions for simpler exploratory data analysis and data wrangling.☆10Feb 6, 2025Updated last year
- My zeromq based home-automation system.☆27Mar 21, 2015Updated 10 years ago
- Exemplos do livro Estatística para Data Science, da Casa do Código☆12Feb 18, 2025Updated 11 months ago
- Automate research and outbound lead generation.☆14May 18, 2025Updated 8 months ago
- Jupyter тетрадка с решением Kaggle соревнования Alfa Campus☆10Oct 22, 2023Updated 2 years ago
- A Machine Learning project for Machine Learning Internship offered by InternshipStudio.☆12Aug 8, 2021Updated 4 years ago
- Computing the gap statistics from Tibshirani et. al. for various clustering algorithms☆13Nov 10, 2025Updated 3 months ago
- Collated optimization models from numerous sources☆13Jun 18, 2023Updated 2 years ago
- En este proyecto de GitHhub podrás encontrar parte del material que utilizo para impartir las clases del módulo introductorio de Reinforc…☆10Apr 22, 2022Updated 3 years ago
- ☆10Mar 19, 2024Updated last year
- RAG as a service to deploy your AI faster☆14Apr 14, 2025Updated 10 months ago
- Python implementation of the control charts used for process monitoring and anomaly detection☆13Jun 18, 2023Updated 2 years ago
- Demo of Machine Learning Prediction Model API with Django REST API Framework☆10Dec 22, 2019Updated 6 years ago
- Detecting Drift in a Diabetes Dataset using Taipy☆12May 19, 2025Updated 8 months ago
- In this project first we fetch data of any stock(NSE) in realtime then we evaluate the stock price using basics visualizations then we…☆12Mar 24, 2023Updated 2 years ago
- Utilizing fastai to classify images of various types of alcoholic beverages☆10Nov 9, 2020Updated 5 years ago
- ML Project control panel☆10Sep 30, 2022Updated 3 years ago
- Forecasting Netflix Customer Retention based on Gaussian Process Regression☆14Jul 22, 2023Updated 2 years ago
- An MOOC offered by the University of Helsinki. Course information can be found below☆10Jun 10, 2021Updated 4 years ago
- The mobile application for 30technologiesin30days challenge https://www.openshift.com/blogs/learning-30-technologies-in-30-days-a-develop…☆14Nov 7, 2013Updated 12 years ago
- [npj Digital Medicine] An In-Depth Evaluation of Federated Learning on Biomedical Natural Language Processing for Information Extraction☆10May 1, 2024Updated last year
- Character Generator☆12Apr 23, 2017Updated 8 years ago
- Lightweight webhook forwarding client☆12Apr 3, 2020Updated 5 years ago
- Mis proyectos de marketing aplicando AI☆11Oct 31, 2025Updated 3 months ago