Here I will be exploring various tools and methods that are used in data engineering process with Python.
☆21Jan 4, 2021Updated 5 years ago
Alternatives and similar repositories for data-engineering-with-python
Users that are interested in data-engineering-with-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perfo…☆10Oct 20, 2017Updated 8 years ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- Aqui você encontra os materiais de um curso COMPLETO de Graduação em Ciência da Computação de uma das melhores universidades do Brasil.☆10Aug 7, 2020Updated 5 years ago
- Final Year Project: EPOS web application implementing an electronic point of sale interface, sales analytics, sales weekly/monthly/yearl…☆16Dec 9, 2021Updated 4 years ago
- Notebooks para prática de conceitos de ML☆10Apr 4, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Programming solution for Hackerrank certification questions. Language: Python3☆12Aug 24, 2023Updated 2 years ago
- Automatically test the performance of a bunch of DNS servers to find the best one☆10Apr 7, 2018Updated 8 years ago
- Storytelling With Matplotlib (SWMat)☆13Jul 25, 2019Updated 7 years ago
- An end-to-end project on customer segmentation☆22Mar 10, 2022Updated 4 years ago
- ☆24Mar 19, 2024Updated 2 years ago
- How Will Your Tweet Be Received? Predicting theSentiment Polarity of Tweet Replies☆12Aug 29, 2021Updated 4 years ago
- ☆11Apr 9, 2022Updated 4 years ago
- ☆13Jan 24, 2023Updated 3 years ago
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks☆10Aug 15, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repository consists of the IPython Notebook for the work related to audio processing and implementing convolution neural networks fo…☆13Feb 13, 2019Updated 7 years ago
- Book Website: Dynamic System Modelling & Analysis with MATLAB & Pythobn☆24Jul 5, 2022Updated 4 years ago
- This is the final project that after participated the Data Engineering Zoomcamp☆11Apr 4, 2022Updated 4 years ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Jul 23, 2020Updated 6 years ago
- From data gathering to model deployment. Complete ML pipeline using Docker, Airflow and Python.☆13Oct 10, 2023Updated 2 years ago
- Teste de rover para back-end☆18Dec 10, 2019Updated 6 years ago
- ☆17Feb 23, 2026Updated 5 months ago
- Predicting the medal table of the Summer Games☆12Jul 6, 2023Updated 3 years ago
- A zero-shot captcha solver.☆16Dec 22, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Oct 12, 2022Updated 3 years ago
- Data Engineering Capstone☆17Oct 10, 2019Updated 6 years ago
- Comprehensive Python Plotly tutorial & cheat sheet. Covers plotly.express, graph_objects & figure_factory for Data Science, 3D plotting, …☆23Dec 3, 2025Updated 7 months ago
- E-commerce intelligent search platform. Pinecone/Devpost Hackathon 2023.☆16Aug 30, 2025Updated 10 months ago
- Here is where the magic happens. This is the scraper repository for AlwaysUpdate Project.☆10Nov 14, 2020Updated 5 years ago
- Este repositório armazena notas de aula de Estatística elaboradas para o curso preparatório de mestrado e doutorado CPAnpec. Adicionalmen…☆17Aug 17, 2021Updated 4 years ago
- Tutorial for understanding CNN basics, video at http://online.codingblocks.com Machine Learning/Deep Learning course.☆12Mar 22, 2019Updated 7 years ago
- This repository contains examples of Kyverno policies for controlling the creation of Cilium Network policies☆22Nov 2, 2023Updated 2 years ago
- Python Machine Learning: Tips, Tricks, and Techniques, published by Packt☆21Jan 15, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆18Apr 22, 2022Updated 4 years ago
- ☆16Aug 13, 2020Updated 5 years ago
- Random Forest-based "Correlation" measures☆15May 3, 2022Updated 4 years ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Jul 24, 2023Updated 3 years ago
- Keep learning something new☆21Jan 21, 2022Updated 4 years ago
- 【Python / Streamlit】Pokemon Sleep 小幫手（寶可夢潛力計算、食譜篩選、寶可夢資訊）☆14May 4, 2024Updated 2 years ago
- Physics Informed Neural Networks☆20Sep 2, 2020Updated 5 years ago