PiercingDan / spark-Jupyter-AWSLinks
A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
☆261Updated 7 years ago
Alternatives and similar repositories for spark-Jupyter-AWS
Users that are interested in spark-Jupyter-AWS are comparing it to the libraries listed below
Sorting:
- Content for architecting a data science platform for products using Luigi, Spark & Flask.☆163Updated 5 years ago
- VM based deployment for prototyping Big Data tools on Amazon Web Services☆128Updated 5 years ago
- Deep Learning for Pugs☆74Updated 7 years ago
- ☆84Updated 7 years ago
- ☆263Updated 5 years ago
- Sample repo for luigi tasks & config☆36Updated 9 years ago
- Curated list of all dataset websites that I find☆84Updated 6 years ago
- DePy 2015 Talk☆117Updated 7 years ago
- Start a cluster in EC2 for dask.distributed☆106Updated 4 years ago
- Magic functions for using Jupyter Notebook with Apache Spark and a variety of SQL databases.☆171Updated 6 years ago
- PyData NYC 2015 conference☆94Updated 9 years ago
- ☆146Updated 9 years ago
- PyData Seattle 2015: Python Data Bikeshed☆127Updated 9 years ago
- ☆52Updated 8 years ago
- Quickstart PySpark with Anaconda on AWS/EMR☆53Updated 8 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆41Updated 9 years ago
- ☆317Updated 4 years ago
- A fork of the cookiecutter-data-science leveraging Docker for local development.☆131Updated 5 years ago
- Open source Flotilla☆194Updated 3 weeks ago
- NOTE: a magic we developed at The Data Incubator from this basis: https://github.com/thedataincubator/ihtml☆88Updated 9 years ago
- Directory of Jupyter notebooks exploring various topics☆316Updated 8 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Updated 9 years ago
- This is a repo documenting the best practices in PySpark.☆464Updated 2 years ago
- Model assisted random sampling.☆119Updated 4 years ago
- PyData London 2016 material☆37Updated 8 years ago
- ☆117Updated last month
- How data science is woven into the fabric of Stitch Fix☆170Updated 5 months ago
- Natural Language Processing with Spark's MLlib☆62Updated 7 years ago
- Observations from Ian on successfully delivering data science products☆543Updated 4 years ago
- Material for some talks I have given☆62Updated 9 months ago