gregbaker / spark-celery
Helper to allow Python Celery tasks to do work in a Spark job.
☆27Updated 2 years ago
Alternatives and similar repositories for spark-celery:
Users that are interested in spark-celery are comparing it to the libraries listed below
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- Python client for Spark Jobserver Rest API☆39Updated 4 years ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Code reference from my Qbox blog posts.☆87Updated 9 years ago
- Pure Python wrapper for the Hadoop WebHDFS Rest API☆52Updated 4 years ago
- Sample Spark Streaming application for secure consumption from Kafka☆33Updated 7 years ago
- Notes about Spark Streaming in Apache Spark☆58Updated 7 years ago
- An Apache access log parser written in Scala☆72Updated 3 years ago
- python library for interacting with SolrCloud☆36Updated 3 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 5 years ago
- Support Highcharts in Apache Zeppelin☆81Updated 7 years ago
- 🚚 ETL for Spark and Airflow☆24Updated 6 years ago
- API and command line interface for HDFS☆273Updated 3 months ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆136Updated 3 years ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- A simple examle for Python Kafka Avro☆86Updated 6 years ago
- A collection of Hive UDFs☆75Updated 4 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 5 years ago
- Ambari Service definition for an Jupyter (IPython3) Notebook service☆42Updated 8 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Cubes OLAP Examples☆75Updated 6 years ago
- A tool and library for easily deploying applications on Apache YARN☆142Updated 10 months ago
- ☆209Updated 8 years ago
- A client for the Confluent Schema Registry API implemented in Python☆52Updated last year
- A spark package for loading Spark ML models to Redis-ML☆63Updated 5 years ago
- Simplify getting Zeppelin up and running☆56Updated 8 years ago
- Lightweight Azkaban client☆77Updated 4 years ago