Some class materials for a data processing course using PySpark
☆52Dec 3, 2022Updated 3 years ago
Alternatives and similar repositories for data_processing_course
Users that are interested in data_processing_course are comparing it to the libraries listed below
Sorting:
- Apache Hadoop - Docker distribution based on CentOS 7 and Oracle Java 8☆12Feb 20, 2018Updated 8 years ago
- Create LAMP Stack using terraform with AWS☆11Feb 15, 2023Updated 3 years ago
- Hadoop Examples☆10Jul 1, 2022Updated 3 years ago
- ☆11Dec 14, 2015Updated 10 years ago
- This project is mainly for learning and practicing simple HIVE commands in real time scenarios. Here we have taken some sample coffee sho…☆11Mar 1, 2018Updated 8 years ago
- Testbench for experimenting with Apache Hive at any data scale.☆64Jul 10, 2017Updated 8 years ago
- Projects from my Hadoop training sessions☆16Feb 22, 2018Updated 8 years ago
- pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4☆69Oct 15, 2024Updated last year
- Deploy Dask on Marathon☆10Feb 6, 2017Updated 9 years ago
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Oct 20, 2017Updated 8 years ago
- Set of Shell scripts to automate Linux from Scratch, based on the book 7.8☆31Jan 10, 2018Updated 8 years ago
- 21st place Kaggle solution for Santander Product Recommendaiton https://www.kaggle.com/c/santander-product-recommendation☆13Aug 29, 2019Updated 6 years ago
- Notes from 100 days with Kubernetes☆30Jan 25, 2019Updated 7 years ago
- Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.☆21Jan 30, 2019Updated 7 years ago
- Repo for data surrounding fast food nutrition and ingredients☆10Nov 11, 2018Updated 7 years ago
- Apache Spark (Scala, PySpark, SparkR) Code, Tricks, and References☆69Jan 21, 2019Updated 7 years ago
- A content-based recommender system for books using the Project Gutenberg text corpus☆29Feb 20, 2017Updated 9 years ago
- Local Development of AWS Glue with Docker and Visual Studio Code☆14Nov 29, 2021Updated 4 years ago
- Dockerfiles for vault, consul, test-kitchen, etsy-mixer, curl-loader, fwd, toolkit☆18Jul 20, 2021Updated 4 years ago
- 📦 Starting box for Vagrant. Inside box Ubuntu 20.04 LTS with Git, Docker and Docker compose.☆19May 5, 2022Updated 3 years ago
- A Scalable Data Cleaning Library for PySpark.☆29Apr 4, 2019Updated 6 years ago
- Udacity Data Engineering Nanodegree Projects☆11Sep 5, 2019Updated 6 years ago
- A collection of data analysis projects done using PySpark via Jupyter notebooks.☆10Oct 8, 2022Updated 3 years ago
- Implementation of Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems☆14Nov 11, 2023Updated 2 years ago
- Rasa Chatbot using Django backend and Sockets for communication☆12Dec 8, 2022Updated 3 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Dec 12, 2018Updated 7 years ago
- My presentation at ODSC India 2018 about Deep Learning with Apache Spark☆27Sep 1, 2018Updated 7 years ago
- Power Plant ML Pipeline Application - Apache Spark☆12Dec 12, 2016Updated 9 years ago
- Ansible roles to install an Spark Standalone cluster (HDFS/Spark/Jupyter Notebook) or Ambari based Spark cluster☆61Jan 30, 2024Updated 2 years ago
- A boilerplate for writing PySpark Jobs☆395Jan 21, 2024Updated 2 years ago
- PredictorFinc is a scalable supervised machine learning model the predicts stock price change through Decision Tree Regressor using data …☆12Sep 5, 2023Updated 2 years ago
- Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.☆68Mar 27, 2023Updated 2 years ago
- running apache spark with docker swarm☆34Feb 25, 2021Updated 5 years ago
- A fast and low memory requirement version of PointHop and PointHop++, which is built upon Apache Spark.☆10Jul 14, 2020Updated 5 years ago
- Realtime Thermal Solar Plant Dataset for Machine Learning☆11Jan 20, 2021Updated 5 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Nov 22, 2021Updated 4 years ago
- A project for the development of rich geospatial data from the city of São Paulo for use in Machine Learning models.☆11Jul 4, 2021Updated 4 years ago
- Spark Projects for the Berkeley Data Science Course☆13Aug 12, 2015Updated 10 years ago
- adidas Data Mesh implementation☆12May 13, 2022Updated 3 years ago