Alternatives and similar repositories for Data_Engineering_with_Python

Users that are interested in Data_Engineering_with_Python are comparing it to the libraries listed below

• dogukannulu / crypto_api_kafka_airflow_streaming
  Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
  ☆16Updated 2 years ago
• ryanbrownnetworking777 / dataengineerio-capstone-ryanbrown
  capstone project for Dataengineer.io bootcamp Public Repo
  ☆12Updated last year
• MartyC-137 / Data-Engineering
  A project portfolio to accompany my resume
  ☆29Updated 2 years ago
• ABZ-Aaron / coincap-api-pipeline
  A simple pipeline utilising cron, Postgres, AWS EC2, and Metabase
  ☆12Updated last year
• LinkedInLearning / end-to-end-data-engineering-project-4413618
  This repo is for the Linkedin Learning course: End-to-End Data Engineering Project
  ☆25Updated 2 years ago
• Nathnael12 / Datawarehouse
  Fully dockerized Data Warehouse (DWH) using Airflow, dbt, PostgreSQL and dashboard using redash
  ☆24Updated 3 years ago
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆22Updated 2 years ago
• Wazzabeee / pyspark-etl-twitter
  Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta…
  ☆18Updated 2 years ago
• longNguyen010203 / Youtube-Recommend-Master-ETL-Pipeline
  A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…
  ☆22Updated last year
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆22Updated 2 years ago
• AuFeld / Data_Engineering_Projects
  A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…
  ☆15Updated 4 years ago
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 3 years ago
• kishlayjeet / Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra
  A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apa…
  ☆27Updated 2 years ago
• jain-rithik / Madflix-GPT
  MadflixGPT is an innovative movie information platform powered by AI, offering personalized movie recommendations based on any query. Exp…
  ☆14Updated last year
• nktnlx / data_analysis_course
  Tasks and projects solved while passing a Data Analysis course: Python, Pandas, Numpy, Seaborn, Google APIs, Git, Airflow, SQL, ClickHous…
  ☆32Updated 4 years ago
• PacktPublishing / Fundamentals-of-Analytics-Engineering
  "Fundamentals of Analytics Engineering, published by Packt"
  ☆19Updated last month
• kzzzr / dbt_clickhouse_lab
  DWH powered by Clickhouse and dbt
  ☆13Updated last year
• pyfenn / fenn
  Friendly Environment for Neural Networks – a simple framework that automates the boring side of ML
  ☆23Updated this week
• lvgalvao / Duckdb-dbt-evidence-insights
  end-to-end data engineering project
  ☆21Updated last year
• andreichiro / data_engineer_end2end
  End-to-end data engineer project
  ☆22Updated 2 years ago
• Mikerniker / 100_Days_of_Python
  These are my projects for Angela Yu's 100 Days of Python Bootcamp
  ☆34Updated 2 months ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆43Updated 2 years ago
• lis-r-barreto / Data-Engineering-Portfolio
  I'm learning how to build data pipelines to work with large datasets. (:
  ☆14Updated 3 years ago
• karolina-sowinska / simple-programming-projects-with-python
  Build your coding portfolio with these simple yet interesting projects in Python
  ☆12Updated 5 years ago
• vedanthv / data-engineering-portfolio
  Cool DE Projects
  ☆46Updated last week
• moontucer / Data-Streaming-Project
  used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline
  ☆29Updated 2 years ago
• anna-geller / prefect-zoomcamp
  Code for the Data Engineering Zoomcamp
  ☆20Updated 3 years ago
• arifszn / velvet
  🥢 The simplest way to create REST API with Node.js, Express.js, and TypeORM.
  ☆10Updated last month
• harshkavdikar1 / Tweet-Analysis-With-Kafka-and-Spark
  A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.
  ☆22Updated last year
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆92Updated last year