danielblazevski / airflow-pyspark-redditLinks
Example of using Airflow to schedule downloading data form S3 and launching spark jobs
☆15Updated 8 years ago
Alternatives and similar repositories for airflow-pyspark-reddit
Users that are interested in airflow-pyspark-reddit are comparing it to the libraries listed below
Sorting:
- Docker compose files for various kafka stacks☆32Updated 7 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 6 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Updated 6 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Dump mysql tables to s3, and parse them☆31Updated 10 years ago
- Setup Apache Airflow on Kubernetes☆10Updated 7 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 9 years ago
- Some class materials for a data processing course using PySpark☆52Updated 2 years ago
- Quickstart PySpark with Anaconda on AWS/EMR☆53Updated 8 years ago
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago
- An example PySpark project with pytest☆16Updated 7 years ago
- Docker images used internally by various Teradata projects for automation, testing, etc☆40Updated 7 years ago
- Mastering Spark for Data Science, published by Packt☆47Updated 2 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 6 years ago
- ☆7Updated 9 years ago
- A cookiecutter template for Apache Spark applications written in Scala☆10Updated 6 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- DataHub on AWS demonstration resources☆10Updated 2 years ago
- A curated list of awesome Apache Spark packages and resources.☆40Updated 8 years ago
- Lightweight configuration and access to multiple databases in a single project☆38Updated last year
- Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana☆20Updated 7 years ago
- Python Streaming Pipelines with Beam on Flink - Demo☆14Updated 2 years ago
- A proof of concept using Divolte, Kafka, Druid and Superset☆61Updated 5 years ago
- Python library for deploying models built using Python to Alteryx Promote.☆15Updated 3 years ago
- Cubes OLAP Examples☆74Updated 7 years ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- Code and Data Samples for Big Data Warehousing.☆10Updated 9 years ago
- ☆111Updated 6 months ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago