Here I will be exploring various tools and methods that are used in data engineering process with Python.
☆21Jan 4, 2021Updated 5 years ago
Alternatives and similar repositories for data-engineering-with-python
Users that are interested in data-engineering-with-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perfo…☆10Oct 20, 2017Updated 8 years ago
- This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)☆11Apr 29, 2022Updated 4 years ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- Aqui você encontra os materiais de um curso COMPLETO de Graduação em Ciência da Computação de uma das melhores universidades do Brasil.☆10Aug 7, 2020Updated 6 years ago
- A notebook showing how to easily convert a current notebook you have to a notebook that can be run on Kubeflow Pipelines.☆15Jul 15, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Final Year Project: EPOS web application implementing an electronic point of sale interface, sales analytics, sales weekly/monthly/yearl…☆16Dec 9, 2021Updated 4 years ago
- Automatically test the performance of a bunch of DNS servers to find the best one☆10Apr 7, 2018Updated 8 years ago
- An end-to-end project on customer segmentation☆22Mar 10, 2022Updated 4 years ago
- How Will Your Tweet Be Received? Predicting theSentiment Polarity of Tweet Replies☆12Aug 29, 2021Updated 4 years ago
- A Discord Bot for distilling papers, GitHub repos, Blogposts, and much more using the power of LLMs and vector search.☆13May 3, 2023Updated 3 years ago
- ☆11Apr 9, 2022Updated 4 years ago
- Demo Repository for eBPF XDP Unit Test☆12Oct 24, 2024Updated last year
- ☆14Dec 5, 2021Updated 4 years ago
- This is the final project that after participated the Data Engineering Zoomcamp☆11Apr 4, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆17Feb 23, 2026Updated 5 months ago
- ☆10Oct 8, 2022Updated 3 years ago
- A zero-shot captcha solver.☆16Dec 22, 2023Updated 2 years ago
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Oct 12, 2022Updated 3 years ago
- Data Engineering Capstone☆17Oct 10, 2019Updated 6 years ago
- Comprehensive Python Plotly tutorial & cheat sheet. Covers plotly.express, graph_objects & figure_factory for Data Science, 3D plotting, …☆23Dec 3, 2025Updated 8 months ago
- Easily import a module and mock its dependencies in an isolated way.☆13May 19, 2022Updated 4 years ago
- E-commerce intelligent search platform. Pinecone/Devpost Hackathon 2023.☆16Aug 30, 2025Updated 11 months ago
- Here is where the magic happens. This is the scraper repository for AlwaysUpdate Project.☆10Nov 14, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Este repositório armazena notas de aula de Estatística elaboradas para o curso preparatório de mestrado e doutorado CPAnpec. Adicionalmen…☆17Aug 17, 2021Updated 4 years ago
- This repository contains examples of Kyverno policies for controlling the creation of Cilium Network policies☆22Nov 2, 2023Updated 2 years ago
- Data Science Cheat Sheet is help to remind code with in minute and also useful to recall the code.Collecting at one place so everyone can…☆25Oct 21, 2017Updated 8 years ago
- Random Forest-based "Correlation" measures☆15May 3, 2022Updated 4 years ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Jul 24, 2023Updated 3 years ago
- Keep learning something new☆21Jan 21, 2022Updated 4 years ago
- Udacity Data Analyst Degree - Project II☆11Sep 25, 2018Updated 7 years ago
- Detailed notes and code to learn the basics of machine learning with scikit-learn.☆36Oct 11, 2016Updated 9 years ago
- Physics Informed Neural Networks☆20Sep 2, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Jul 17, 2023Updated 3 years ago
- 50 Kubernetes Concepts Every DevOps Engineer Should Know, Published by Packt☆42Apr 22, 2026Updated 3 months ago
- remaking Aman Kharwal's 60 Python Projects with Source Code☆17May 29, 2026Updated 2 months ago
- A simple property onboarding API built with FastAPI☆13May 29, 2022Updated 4 years ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 2 years ago
- Repository for my Talos Linux/Kubernetes cluster☆22Updated this week
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆45Jan 4, 2024Updated 2 years ago