Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
☆37Sep 1, 2023Updated 2 years ago
Alternatives and similar repositories for csv_extract_airflow_docker
Users that are interested in csv_extract_airflow_docker are comparing it to the libraries listed below
Sorting:
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 2 years ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 2 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆145Jul 27, 2023Updated 2 years ago
- This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.☆13Sep 5, 2024Updated last year
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Jul 21, 2023Updated 2 years ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆16Mar 14, 2024Updated last year
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 2 years ago
- ☆19Feb 25, 2022Updated 4 years ago
- Tensorflow implementation of time series generation using a variational autoencoder☆27Aug 12, 2024Updated last year
- Quick set of sorting algorithms using Java.☆11Sep 13, 2016Updated 9 years ago
- ☆10Aug 6, 2024Updated last year
- This project contains my solution for all the data structures and algorithms on Algo Expert, Hackerrank and Leetcode. This repository is …☆11Jan 24, 2021Updated 5 years ago
- In this project I used ML modeling and data analysis to predict ad clicks and significantly improve ad campaign performance, resulting in…☆12Nov 6, 2023Updated 2 years ago
- ☆15Mar 18, 2025Updated 11 months ago
- A dashboard that supports fleet managers and decision makers to gain insights into their automotive fleets and optimize them☆13Mar 20, 2021Updated 4 years ago
- Daily updated fake data for DBT learning and projects☆35Jan 7, 2024Updated 2 years ago
- Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase☆43Jul 19, 2024Updated last year
- Code I use in my medium blog/articles.☆39Jun 9, 2025Updated 8 months ago
- Jupyter тетрадка с решением Kaggle соревнования Alfa Campus☆10Oct 22, 2023Updated 2 years ago
- My zeromq based home-automation system.☆27Mar 21, 2015Updated 10 years ago
- Heranow website and dashboard☆12Nov 13, 2024Updated last year
- Main server code for Django server and facial recognition verification☆13Sep 13, 2017Updated 8 years ago
- A script/docker that automatically translates PDFs using the DeepL API☆11Jan 18, 2026Updated last month
- ☆12Jul 2, 2023Updated 2 years ago
- FastPy-RS is a high-performance Python library that provides optimized implementations of common functions using Rust.☆18Aug 19, 2025Updated 6 months ago
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆16Mar 11, 2025Updated 11 months ago
- Template for machine learning projects.☆12Jul 22, 2023Updated 2 years ago
- Automate research and outbound lead generation.☆14May 18, 2025Updated 9 months ago
- A Machine Learning project for Machine Learning Internship offered by InternshipStudio.☆12Aug 8, 2021Updated 4 years ago
- Exemplos do livro Estatística para Data Science, da Casa do Código☆12Feb 18, 2025Updated last year
- Stock-keeping-oriented Prediction Error Costs (SPEC)☆12Jul 3, 2020Updated 5 years ago
- ☆10Apr 18, 2024Updated last year
- Collated optimization models from numerous sources☆13Jun 18, 2023Updated 2 years ago
- 👨🏻💻 My Personal Homepage☆13Updated this week
- These projects use pandas, matplotlib, numpy, scipy and scikitlearn☆11Jun 12, 2022Updated 3 years ago
- Rucio K8s tutorial☆11Sep 26, 2025Updated 5 months ago
- geo libs, hacks and practices☆12Sep 21, 2020Updated 5 years ago
- ☆15Jul 25, 2025Updated 7 months ago