InsightDataScience / pegasus
VM based deployment for prototyping Big Data tools on Amazon Web Services
☆128Updated 4 years ago
Alternatives and similar repositories for pegasus:
Users that are interested in pegasus are comparing it to the libraries listed below
- Repo to migrate old wiki to, esp for devs and code examples☆185Updated 8 years ago
- An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…☆90Updated 9 years ago
- A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support☆261Updated 7 years ago
- Content for architecting a data science platform for products using Luigi, Spark & Flask.☆163Updated 5 years ago
- Scripts used to setup a Spark cluster on EC2☆393Updated 7 years ago
- Learn the pyspark API through pictures and simple examples☆170Updated 4 years ago
- Sample repo for luigi tasks & config☆36Updated 8 years ago
- DataPipeline for humans.☆251Updated 2 years ago
- A command-line tool for launching Apache Spark clusters.☆642Updated 3 months ago
- ☆146Updated 9 years ago
- An API to Analyze Cab GeoLocation Data and a Simulated App for finding an available cab in Real-Time☆63Updated 10 years ago
- Apache Spark (Scala, PySpark, SparkR) Code, Tricks, and References☆69Updated 6 years ago
- User-friendly Teradata client for Python☆107Updated 3 years ago
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆363Updated 7 years ago
- Coding exercises for Apache Spark☆104Updated 9 years ago
- ☆24Updated 9 years ago
- PySpark Cassandra brings back the fun in working with Cassandra data in PySpark.☆79Updated 7 years ago
- Quickstart PySpark with Anaconda on AWS/EMR☆53Updated 8 years ago
- Training materials for Strata, AMP Camp, etc☆149Updated 9 years ago
- A short guide for transitioning from Python to Scala☆65Updated 9 years ago
- tutorials and samples that show you how get the most out of IBM Analytics for Apache Spark☆79Updated 7 years ago
- Supporting content (slides and exercises) for the Addison-Wesley (Pearson) video series covering best practices for developing scalable S…☆66Updated 9 years ago
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 5 years ago
- Data Science box: Spark, Jupyter, R+RStudio, Zeppelin, Python 2 & 3, Java, Scala.☆39Updated 6 years ago
- Data and code for "Fast Data Applications with Spark and Python"☆25Updated 8 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Information for setting up for the BerkeleyX Spark Intro MOOC, and lab assignments for the course☆349Updated 4 years ago
- A luigi powered analytics / warehouse stack☆87Updated 8 years ago
- Data Science in 30 Minutes #5: Spark☆19Updated 8 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated last year