CoorpAcademy / docker-pyspark

Related projects: ⓘ

• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 3 years ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆85Updated 8 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• groupon / luigi-warehouse
  A luigi powered analytics / warehouse stack
  ☆87Updated 7 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆67Updated 5 years ago
• alexvanboxel / airflow-gcp-examples
  Repository with examples and smoke tests for the GCP Airflow operators and hooks
  ☆146Updated 7 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆94Updated 5 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• anguenot / pyspark-cassandra
  pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4
  ☆69Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 5 years ago
• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆192Updated 3 months ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆171Updated 10 months ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 5 years ago
• geosolutions-it / evo-odas
  Code Repository for the EVO-ODAS
  ☆31Updated 6 years ago
• datitran / emr-bootstrap-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR
  ☆53Updated 7 years ago
• talperetz / scalable-airflow-template
  fast and scalable Airflow on Kubernetes Setup.
  ☆28Updated last year
• amwaleh / Simple-stream-Kafka
  This is a simple streaming application that utilises Kafka and Python
  ☆45Updated 5 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated 11 months ago
• trbs / airflow-examples
  ☆28Updated 3 years ago
• agawronski / pandas_redshift
  Load data from redshift into a pandas DataFrame and vice versa.
  ☆138Updated last year
• awantik / pyspark-learning
  Updated repository
  ☆157Updated 2 years ago
• Soluto / spark-submit-with-pyspark-template
  ☆39Updated this week
• rdblue / jupyter-zeppelin
  Conversion utility from Zeppelin notes to Jupyter notebooks.
  ☆44Updated 4 years ago
• spiside / docker-luigi
  A project to help develop Luigi pipelines using Docker ✳️
  ☆78Updated 3 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆75Updated 5 years ago
• postrational / airflow_tutorial
  ☆54Updated 5 years ago
• jkthompson / pyspark-pictures
  Learn the pyspark API through pictures and simple examples
  ☆168Updated 3 years ago