Here I will be exploring various tools and methods that are used in data engineering process with Python.
☆21Jan 4, 2021Updated 5 years ago
Alternatives and similar repositories for data-engineering-with-python
Users that are interested in data-engineering-with-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perfo…☆10Oct 20, 2017Updated 8 years ago
- Personal README for Github profile.☆10Jun 12, 2023Updated 3 years ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- Aqui você encontra os materiais de um curso COMPLETO de Graduação em Ciência da Computação de uma das melhores universidades do Brasil.☆10Aug 7, 2020Updated 6 years ago
- Repo for the paper: Climate change in the High Mountain Asia in CMIP6☆13Sep 10, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Programming solution for Hackerrank certification questions. Language: Python3☆12Aug 24, 2023Updated 3 years ago
- An end-to-end project on customer segmentation☆22Mar 10, 2022Updated 4 years ago
- ☆24Mar 19, 2024Updated 2 years ago
- How Will Your Tweet Be Received? Predicting theSentiment Polarity of Tweet Replies☆12Aug 29, 2021Updated 5 years ago
- ☆13Jan 24, 2023Updated 3 years ago
- Variant for Visual GPT with better UI using h2o Wave & Single GPU support☆15Mar 12, 2023Updated 3 years ago
- This repository consists of the IPython Notebook for the work related to audio processing and implementing convolution neural networks fo…☆13Feb 13, 2019Updated 7 years ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Jul 23, 2020Updated 6 years ago
- Teste de rover para back-end☆18Dec 10, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Aug 18, 2026Updated last month
- ☆11Feb 29, 2024Updated 2 years ago
- A zero-shot captcha solver.☆16Dec 22, 2023Updated 2 years ago
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Oct 12, 2022Updated 3 years ago
- Data Engineering Capstone☆17Oct 10, 2019Updated 6 years ago
- Comprehensive Python Plotly tutorial & cheat sheet. Covers plotly.express, graph_objects & figure_factory for Data Science, 3D plotting, …☆24Dec 3, 2025Updated 9 months ago
- Easily import a module and mock its dependencies in an isolated way.☆13May 19, 2022Updated 4 years ago
- A conda-smithy repository for matplotlib.☆22Updated this week
- Feature Store with Spark Streaming, Kafka, Redis☆16Aug 13, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Tutorial for understanding CNN basics, video at http://online.codingblocks.com Machine Learning/Deep Learning course.☆12Mar 22, 2019Updated 7 years ago
- Python Machine Learning: Tips, Tricks, and Techniques, published by Packt☆21Jan 15, 2021Updated 5 years ago
- eBPF container escape detector prototype | Kernel 6.8+ | Early dev phase | Expect kernel panics ⚠️☆16Apr 27, 2026Updated 4 months ago
- ☆16Aug 13, 2020Updated 6 years ago
- Data Science Cheat Sheet is help to remind code with in minute and also useful to recall the code.Collecting at one place so everyone can…☆25Oct 21, 2017Updated 8 years ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Jul 24, 2023Updated 3 years ago
- Keep learning something new☆21Jan 21, 2022Updated 4 years ago
- Detailed notes and code to learn the basics of machine learning with scikit-learn.☆36Oct 11, 2016Updated 9 years ago
- Physics Informed Neural Networks☆20Sep 2, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆21Jul 17, 2023Updated 3 years ago
- Python Tutorials for YouTube☆39Sep 4, 2023Updated 3 years ago
- remaking Aman Kharwal's 60 Python Projects with Source Code☆17May 29, 2026Updated 3 months ago
- A simple property onboarding API built with FastAPI☆13May 29, 2022Updated 4 years ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 3 years ago
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆46Jan 4, 2024Updated 2 years ago
- ☆18Feb 15, 2023Updated 3 years ago