Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
☆37Sep 1, 2023Updated 2 years ago
Alternatives and similar repositories for csv_extract_airflow_docker
Users that are interested in csv_extract_airflow_docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 2 years ago
- Docker Apache Airflow☆13Mar 1, 2023Updated 3 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Jul 21, 2023Updated 2 years ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 2 years ago
- ☆13May 11, 2025Updated 10 months ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.☆13Sep 5, 2024Updated last year
- ☆15Dec 23, 2021Updated 4 years ago
- Collection of samples, scripts, and utilities for working with the Microsoft BI Stack (SSRS, SSIS, SSAS, PowerBI, SQL)☆17Jun 11, 2024Updated last year
- Rucio K8s tutorial☆11Sep 26, 2025Updated 6 months ago
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆16Mar 11, 2025Updated last year
- ☆16Mar 18, 2025Updated last year
- Chat with your dataset! This project demonstrates a web-based application to query a dataset through natural language.☆56Nov 30, 2023Updated 2 years ago
- A simple tool for monitoring the progress of OpenFOAM simulations☆12Nov 9, 2018Updated 7 years ago
- Apache Airflow advanced functionalities examples☆21Mar 22, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated last year
- Geographical Graph Attention Networks: Spatial Deep Learning Models for Spatial Prediction and Exploratory Spatial Data Analysis☆17Jul 28, 2025Updated 7 months ago
- Coding with ChatGPT 4☆12Jun 15, 2023Updated 2 years ago
- Source Code for "Practical OpenTelemetry: Adopting Open Observability Standards Across Your Organization" by Daniel Gomez Blanco☆21Mar 6, 2023Updated 3 years ago
- This project demonstrates real-time data streaming and processing architecture using Kafka, Spark Streaming, and Debezium for capturing C…☆13Oct 24, 2024Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated last year
- RuCLIP-SB (Russian Contrastive Language–Image Pretraining SWIN-BERT) is a multimodal model for obtaining images and text similarities and…☆14Jan 25, 2022Updated 4 years ago
- This repo consists of all important concepts for data engineers.☆11Dec 24, 2024Updated last year
- ☆13Oct 13, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code repository for Python for Beginners: Learn Python from Scratch, published by Packt☆16Oct 16, 2023Updated 2 years ago
- GitHub Actions Dashboard☆17Mar 9, 2026Updated 2 weeks ago
- ☆14Apr 20, 2023Updated 2 years ago
- Data Structures in Python☆10Mar 16, 2026Updated last week
- ☆19Feb 25, 2022Updated 4 years ago
- Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator☆12May 23, 2021Updated 4 years ago
- Use a AWS Glue Python Shell Job to connect to your Amazon Redshift cluster and execute a SQL script stored in Amazon S3.☆21Aug 8, 2022Updated 3 years ago
- Classify documents using Python based on SVM and TF-IDF.☆15Nov 19, 2019Updated 6 years ago
- Tensorflow implementation of time series generation using a variational autoencoder☆27Aug 12, 2024Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Ansible for Kubernetes by Examples by Luca Berton☆12Dec 25, 2023Updated 2 years ago
- Our solution to ML Talent Match hackathon☆11Mar 22, 2024Updated 2 years ago
- An interactive web application built on CARTO and D3 for visualizing relationships between traffic crashes and poverty in NYC.☆12Sep 7, 2016Updated 9 years ago
- A Python package for working with OpenFOAM.☆15Oct 2, 2024Updated last year
- 📷 💾 Python bulk instagram scraper for photos and videos using Selenium and BS4.☆17Jun 15, 2025Updated 9 months ago
- Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase☆44Jul 19, 2024Updated last year
- This project contains my solution for all the data structures and algorithms on Algo Expert, Hackerrank and Leetcode. This repository is …☆10Jan 24, 2021Updated 5 years ago