mehd-io / pyspark-boilerplate-mehdioView external linksLinks
Pyspark boilerplate for running prod ready data pipeline
☆29Mar 17, 2021Updated 4 years ago
Alternatives and similar repositories for pyspark-boilerplate-mehdio
Users that are interested in pyspark-boilerplate-mehdio are comparing it to the libraries listed below
Sorting:
- Boilerplate for PySpark on Cloud Kubernetes☆33Oct 12, 2021Updated 4 years ago
- A content-based recommender system for books using the Project Gutenberg text corpus☆29Feb 20, 2017Updated 8 years ago
- PDF to JSON, JSON to PDF and etc.☆12Apr 18, 2018Updated 7 years ago
- ☆14Sep 14, 2021Updated 4 years ago
- ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipelin…☆11Mar 9, 2022Updated 3 years ago
- A Python library for building modular, reproducible simulation pipelines in minutes☆32Aug 22, 2025Updated 5 months ago
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- A collection of data analysis projects done using PySpark via Jupyter notebooks.☆10Oct 8, 2022Updated 3 years ago
- This web scraper is intended to extract data from The Home Depot Website, it could be run locally or in the Apify platform, the latter is…☆10Oct 13, 2022Updated 3 years ago
- A set of Jupyter Lab Notebooks and Other Implementations of Community Reports in Standard Form☆18Apr 15, 2024Updated last year
- Distributed stock price forecasting system to predict S&P 500 stock prices.☆11Nov 12, 2021Updated 4 years ago
- A project for the development of rich geospatial data from the city of São Paulo for use in Machine Learning models.☆11Jul 4, 2021Updated 4 years ago
- Docker compose and Google Colab demo to build a CDC with Delta Lake☆15Sep 7, 2022Updated 3 years ago
- Sample project showing how to customize the facebook login button☆10Mar 13, 2016Updated 9 years ago
- A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role☆10Jan 9, 2026Updated last month
- This is a pipeline of an ETL application in GCP with open airport code data, which you can find here: https://datahub.io/core/airport-cod…☆15Nov 15, 2021Updated 4 years ago
- Coder in your OpenShift/Kubernetes Cluster or in Docker☆10Oct 22, 2021Updated 4 years ago
- A nicer UI for AWS Glue Data Catalog☆10Jun 27, 2022Updated 3 years ago
- ☆12Mar 12, 2024Updated last year
- Terraform module to provision a scheduled Lambda function which will delete old AWS ElasticSearch indices☆13Jan 7, 2026Updated last month
- ☆14Jul 8, 2025Updated 7 months ago
- Implemention based on lightrag and nano-graphrag to connect with psql☆15Oct 28, 2024Updated last year
- Stationary Bike "Smart" trainer gaming motivator. Connects to Bluetooth LE smart trainers and disables your game controller if you drop b…☆11Aug 9, 2021Updated 4 years ago
- Spark Projects for the Berkeley Data Science Course☆13Aug 12, 2015Updated 10 years ago
- Run a Spark job within Amazon EMR☆12Sep 12, 2020Updated 5 years ago
- A Gentle introduction to Machine Learning with Apache Spark☆11Jun 27, 2025Updated 7 months ago
- ☆15Aug 22, 2022Updated 3 years ago
- Glue VSCode devcontainer setup☆14Jan 31, 2023Updated 3 years ago
- Visits sessionization pipeline used for the talk☆13May 28, 2024Updated last year
- Inspired by mtrovo's https://github.com/mtrovo/wg-gesucht-scraper☆12Sep 9, 2025Updated 5 months ago
- A fast and low memory requirement version of PointHop and PointHop++, which is built upon Apache Spark.☆10Jul 14, 2020Updated 5 years ago
- Clickstream Faker Provider for Python.☆11Apr 2, 2022Updated 3 years ago
- Analyzing Big Data with Amazon EMR☆12Sep 14, 2020Updated 5 years ago
- THIS PROJECT IS ABOUT TURKISH SENTIMENT ANALYSIS☆14Aug 23, 2019Updated 6 years ago
- Github action which publishes python packages that use poetry☆12Mar 1, 2021Updated 4 years ago
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11May 22, 2018Updated 7 years ago
- noiseprint2 is a porting of noiseprint to tensorflow 2 and keras☆12Feb 20, 2021Updated 4 years ago
- Example of how to build machine learning training workflow on AWS by Prefect☆12Nov 2, 2022Updated 3 years ago
- Small examples of creative use of our projects☆11Jul 30, 2025Updated 6 months ago