A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
☆38Mar 29, 2021Updated 5 years ago
Alternatives and similar repositories for spark-livy-on-airflow-workspace
Users that are interested in spark-livy-on-airflow-workspace are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Kafka and Spark Integration. Alll code in maven project.☆14Nov 16, 2022Updated 3 years ago
- Docker with Airflow and Spark standalone cluster☆265Aug 5, 2023Updated 2 years ago
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- ITMD - 526 Data Warehousing☆29May 9, 2016Updated 10 years ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆135Nov 4, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ⚙️ Simple GitHub CLI extension to list all (own|starred) repositories.☆16Jul 15, 2024Updated last year
- learn calcite sql parsing☆18Sep 16, 2022Updated 3 years ago
- Upload watson time logs to Jira Tempo worklogs☆10Feb 15, 2023Updated 3 years ago
- Deep Learning Pipelines for Apache Spark☆18Jun 22, 2017Updated 9 years ago
- Simple dashboard (follows MVC pattern) for monitoring temperature, humidity, gas, and sound Arduino sensors via using Kafka (stream-proce…☆11Mar 1, 2023Updated 3 years ago
- ☆25Dec 21, 2020Updated 5 years ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- Genrates python dependency graph☆22Aug 10, 2018Updated 7 years ago
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆511Nov 7, 2025Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆24May 14, 2022Updated 4 years ago
- Online Anomaly Detection for HPC Performance Data☆11Jun 25, 2018Updated 8 years ago
- Module for pipelines concept in PySpark☆17Mar 27, 2024Updated 2 years ago
- Generate DBT tests based on sample data☆39Feb 28, 2024Updated 2 years ago
- Example of orchestrating dependent Databricks jobs using Airflow☆11Dec 19, 2019Updated 6 years ago
- Gotta stay sharp! Common algorithms and puzzles implemented in C, Java, and Python.☆16Jan 13, 2015Updated 11 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Jul 6, 2022Updated 3 years ago
- Library which aim to generate kubernetes yamls templates from an Airflow dag using the Airflow Kuberntes Pod Operator☆10May 6, 2021Updated 5 years ago
- Apache Spark 3 for Data Engineering and Analytics with Python , By Packt publishing☆24Jul 23, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Building Event Driven Application with AWS Lambda and Amazon Redshift Data API☆17Oct 27, 2020Updated 5 years ago
- A docker image for HDFS FileBrowser. Cloudera Hue with FileBrowser only.☆11Sep 20, 2018Updated 7 years ago
- Proxified Promise Chain in JavaScript☆20May 23, 2021Updated 5 years ago
- A Docker Compose template that builds a interactive development environment for PySpark with Jupyter Lab, MinIO as object storage, Hive M…☆47Dec 19, 2024Updated last year
- Hyper-Scale Machine Learning with MinIO and TensorFlow☆11Mar 25, 2023Updated 3 years ago
- Deploying a Machine Learning model streaming application with Apache Kafka☆11Aug 21, 2022Updated 3 years ago
- ☆13Aug 4, 2021Updated 4 years ago
- ☆13Sep 19, 2018Updated 7 years ago
- Jupyter notebooks for the teaching of mechanics☆11Oct 8, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- EMNLP 2024 Findings "Schema-Driven Information Extraction from Heterogeneous Tables"☆28Dec 5, 2024Updated last year
- A simple Perceptron in Python☆10Feb 11, 2022Updated 4 years ago
- ☆11Oct 9, 2015Updated 10 years ago
- ☆12Aug 27, 2020Updated 5 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Jan 31, 2023Updated 3 years ago
- ☆17Apr 19, 2024Updated 2 years ago
- MVC framework for Unity3d.☆23Nov 23, 2020Updated 5 years ago