gregbaker / spark-celery
Helper to allow Python Celery tasks to do work in a Spark job.
☆27Updated 2 years ago
Alternatives and similar repositories for spark-celery:
Users that are interested in spark-celery are comparing it to the libraries listed below
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Example for an airflow plugin☆49Updated 8 years ago
- PySpark for Elastic Search☆55Updated 8 years ago
- Code reference from my Qbox blog posts.☆87Updated 9 years ago
- Python client for Hadoop® YARN API☆109Updated 2 years ago
- Scripts for building Cloudera Manager parcel and CSD for Livy Spark Server☆21Updated 7 years ago
- Sample UDF and UDAs for Impala.☆64Updated 5 years ago
- Kite SDK Examples☆99Updated 3 years ago
- python library for interacting with SolrCloud☆36Updated 4 years ago
- An Apache access log parser written in Scala☆72Updated 4 years ago
- Pure Python wrapper for the Hadoop WebHDFS Rest API☆52Updated 4 years ago
- A wrapper for libhdfs3 to interact with HDFS from Python☆136Updated 4 years ago
- ElasticSearch integration for Apache Spark☆47Updated 8 years ago
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago
- Code to index HDFS to Solr using MapReduce☆52Updated 6 years ago
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆50Updated 8 years ago
- Simplify getting Zeppelin up and running☆56Updated 8 years ago
- An Apache Spark-shell backend for IPython☆105Updated 3 years ago
- Hadoop Cluster Configurations☆32Updated 3 years ago
- Jupyter kernel for scala and spark☆188Updated last year
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆98Updated 4 years ago
- Phoenix database adapter for Python (migrated to the Apache Phoenix repo)☆26Updated 3 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- A collection of Hive UDFs☆75Updated 5 years ago
- Docker images used internally by various Teradata projects for automation, testing, etc☆40Updated 7 years ago
- A Python MapReduce and HDFS API for Hadoop☆238Updated last month
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 5 years ago
- ☆54Updated 10 years ago
- Python client for Spark Jobserver Rest API☆39Updated 5 years ago