patvarilly / python-and-spark-for-data-analysis
A four-day course on Python, the Scientific Python stack and PySpark, adapted from a training course I gave to one of our clients in December 2015
☆10Updated 9 years ago
Alternatives and similar repositories for python-and-spark-for-data-analysis:
Users that are interested in python-and-spark-for-data-analysis are comparing it to the libraries listed below
- Airflow training for the crunch conf☆105Updated 6 years ago
- Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle☆33Updated 8 years ago
- A simple introduction to using spark ml pipelines☆26Updated 7 years ago
- PySpark phonetic and string matching algorithms☆39Updated last year
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆38Updated 9 months ago
- Sharing interesting and noteworthy Data Engineering content☆67Updated 8 years ago
- A simple Spark TDD example☆26Updated 7 years ago
- Workshop for Spark and Databricks☆54Updated 5 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- ☆199Updated last year
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Load data from redshift into a pandas DataFrame and vice versa.☆138Updated last year
- Repository used for Spark Trainings☆53Updated 2 years ago
- A four-day course on Python, the Scientific Python stack and PySpark, adapted from a training course given by Patrick Varilly to one of o…☆11Updated 9 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆196Updated 5 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆107Updated last week
- ☆16Updated 7 years ago
- Code supporting Data Science articles at The Marketing Technologist, Floryn Tech Blog, and Pythom.nl☆71Updated 2 years ago
- My machine learning model for the See Click Predict Fix Kaggle competition☆31Updated 7 years ago
- Course materials for my data pipeline video course with O'Reilly☆196Updated 7 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 9 years ago
- A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…☆26Updated 5 years ago
- ☆19Updated 4 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- A couple projects using scikit-learn illustrating project decision making.☆15Updated 8 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 8 years ago
- ML Nanodegree Capstone Project - Predicting NYC Taxi Trip Duration☆12Updated 7 years ago
- A lightweight data processing framework for Apache Spark☆16Updated 2 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆87Updated 4 years ago
- ☆84Updated 2 years ago