Here I will be exploring various tools and methods that are used in data engineering process with Python.
☆21Jan 4, 2021Updated 5 years ago
Alternatives and similar repositories for data-engineering-with-python
Users that are interested in data-engineering-with-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Personal README for Github profile.☆10Jun 12, 2023Updated 3 years ago
- Repo for the paper: Climate change in the High Mountain Asia in CMIP6☆13Sep 10, 2021Updated 5 years ago
- Notebooks para prática de conceitos de ML☆10Apr 4, 2023Updated 3 years ago
- Programming solution for Hackerrank certification questions. Language: Python3☆12Aug 24, 2023Updated 3 years ago
- Automatically test the performance of a bunch of DNS servers to find the best one☆11Apr 7, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An end-to-end project on customer segmentation☆22Mar 10, 2022Updated 4 years ago
- Statistical dowscaling of climate data at daily scale using quantile mapping (QPM) technique.☆18May 26, 2022Updated 4 years ago
- ☆11Apr 9, 2022Updated 4 years ago
- Implementation of Quantum Perceptron: An Artificial Neuron Implemented on an Actual Quantum Processor☆10Mar 30, 2025Updated last year
- This is the final project that after participated the Data Engineering Zoomcamp☆11Apr 4, 2022Updated 4 years ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Jul 23, 2020Updated 6 years ago
- From data gathering to model deployment. Complete ML pipeline using Docker, Airflow and Python.☆13Oct 10, 2023Updated 3 years ago
- Teste de rover para back-end☆18Dec 10, 2019Updated 6 years ago
- Predicting the medal table of the Summer Games☆12Jul 6, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A zero-shot captcha solver.☆16Dec 22, 2023Updated 2 years ago
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Oct 12, 2022Updated 4 years ago
- Discover the perfect harmony of tunes and movies!☆10Aug 17, 2023Updated 3 years ago
- Minimalist MATLAB template for scientific figures☆21May 28, 2025Updated last year
- MoodCat😼 classifies the mood of English sentences.☆14Jun 19, 2022Updated 4 years ago
- Comprehensive Python Plotly tutorial & cheat sheet. Covers plotly.express, graph_objects & figure_factory for Data Science, 3D plotting, …☆24Dec 3, 2025Updated 10 months ago
- Feature Store with Spark Streaming, Kafka, Redis☆16Aug 13, 2021Updated 5 years ago
- A conda-smithy repository for matplotlib.☆22Updated this week
- eBPF container escape detector prototype | Kernel 6.8+ | Early dev phase | Expect kernel panics ⚠️☆15Apr 27, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆19Apr 22, 2022Updated 4 years ago
- Python implementation of random-forest-based nonlinear dependence and correlation measures.☆15May 3, 2022Updated 4 years ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Jul 24, 2023Updated 3 years ago
- Keep learning something new☆21Jan 21, 2022Updated 4 years ago
- 【Python / Streamlit】Pokemon Sleep 小幫手（寶可夢潛力計算、食譜篩選、寶可夢資訊）☆15May 4, 2024Updated 2 years ago
- Physics Informed Neural Networks☆20Sep 2, 2020Updated 6 years ago
- Examples of using Redis OM Python with FastAPI☆24Jan 20, 2022Updated 4 years ago
- Python Tutorials for YouTube☆39Sep 4, 2023Updated 3 years ago
- remaking Aman Kharwal's 60 Python Projects with Source Code☆17May 29, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Repository for my Talos Linux/Kubernetes cluster☆23Sep 30, 2026Updated last week
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆47Jan 4, 2024Updated 2 years ago
- Create your own DALL-E application in Python with Streamlit.☆12Mar 9, 2023Updated 3 years ago
- Spark and Python (PySpark) Examples☆38Jul 7, 2021Updated 5 years ago
- Sales Conversion Optimization MLOps: Boost revenue with AI-powered insights. Features H2O AutoML, ZenML pipelines, Neptune.ai tracking, d…☆20Mar 22, 2025Updated last year
- A curated, taxonomy-organized collection of 50+ papers on Scientific Foundation Models (SciFMs) across 14+ domains — from climate and mat…☆37Jul 16, 2026Updated 2 months ago
- ☆32Aug 13, 2018Updated 8 years ago