jwplayer / sparkstepsLinks
CLI tool to launch Spark jobs on AWS EMR
☆67Updated last year
Alternatives and similar repositories for sparksteps
Users that are interested in sparksteps are comparing it to the libraries listed below
Sorting:
- ☆54Updated 7 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Updated 9 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Updated 6 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Helpers & syntactic sugar for PySpark.☆62Updated last year
- Example for an airflow plugin☆49Updated 8 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.☆21Updated 6 months ago
- Quickstart PySpark with Anaconda on AWS/EMR☆53Updated 8 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- A collection of airflow sample workflows for data processing on aws☆12Updated 7 years ago
- Plugin offering views, operators, sensors, and more developed at Pandora Media.☆26Updated 7 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Send summary messages of your Luigi jobs to Slack☆46Updated 6 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.☆96Updated 4 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- Luigi Plugin for Hubot☆36Updated 8 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆23Updated 9 years ago
- The sane way of building a data layer in Airflow☆24Updated 5 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆41Updated 9 years ago
- T4 is now in production as Quilt 3☆64Updated 6 years ago
- A luigi powered analytics / warehouse stack☆88Updated 8 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 5 years ago
- An example PySpark project with pytest☆16Updated 7 years ago
- Presto-like CLI tool for AWS Athena☆84Updated 2 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 2 months ago
- Open source Flotilla☆194Updated 3 weeks ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year