IhorLuk / medium-materials
☆14Updated 10 months ago
Alternatives and similar repositories for medium-materials:
Users that are interested in medium-materials are comparing it to the libraries listed below
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆35Updated last year
- ☆9Updated last week
- Retail data pipeline using Airflow, Dbt, Soda, GCP (GCS and BigQuery) and Metabase☆37Updated 9 months ago
- Fully reproducible, Dockerized, step-by-step, tutorial on how to mock a "real-time" Kafka data stream from a timestamped csv file. Detai…☆39Updated 3 years ago
- Spyrk-cluster is a data mini-lab, considering the main technologies used these days. It's useful to either understand how to configure a …☆29Updated 4 years ago
- An exercise running Kafka, Kafka Connect, PostgreSQL, Superset and AWS S3☆21Updated 3 years ago
- Data Engineering com Apache Spark☆42Updated 3 years ago
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆23Updated 3 years ago
- AWS ETL Pipleine☆28Updated 11 months ago
- A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc☆14Updated 3 years ago
- Repositório central do segundo Workshop☆15Updated last year
- Portfolio of projects and studies conducted in data engineering.☆33Updated 2 months ago
- Exercícios do módulo 1 - Bootcamp EDC - IGTI 2021☆49Updated 2 years ago
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆24Updated 2 years ago
- Documentação do Treinamento DP-900 do Canal da Cloud☆31Updated 3 years ago
- ☆23Updated last year
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆41Updated last year
- Essential PySpark for Scalable Data Analytics, published by Packt☆44Updated 2 years ago
- ☆62Updated last year
- Desafio 5DataGlowUp☆22Updated last year
- ☆21Updated 3 years ago
- ☆16Updated 10 months ago
- Modern Data Stack☆62Updated 8 months ago
- This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process☆46Updated 2 years ago
- Airflow Tutorials☆24Updated 4 years ago
- Script para ingestão de dados do Mercado Bitcoin☆10Updated last year
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- Found a data engineering challenge or participated in a selection process ? Share with us!☆65Updated 2 years ago
- ☆13Updated 9 months ago
- Project for real-time anomaly detection using Kafka and python☆58Updated 2 years ago