A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
☆38Mar 29, 2021Updated 5 years ago
Alternatives and similar repositories for spark-livy-on-airflow-workspace
Users that are interested in spark-livy-on-airflow-workspace are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Spark Standalone & Livy☆11Jul 13, 2021Updated 5 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 3 years ago
- Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks☆24Apr 2, 2022Updated 4 years ago
- My solutions from Google Foobar. For educational purposes only.☆10Sep 21, 2017Updated 9 years ago
- ☆12Mar 5, 2021Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆11Jul 13, 2020Updated 6 years ago
- Dockerizing and Consuming an Apache Livy environment☆13Jun 29, 2022Updated 4 years ago
- Learn about MongoDb using Pymongo and python☆12Oct 14, 2020Updated 6 years ago
- Source code for our course DevOps Deployment Automation with Terraform, AWS and Docker: https://londonapp.dev/c3☆12Nov 22, 2024Updated last year
- This repository contains a set of hands-on challenges designed to introduce you to Dapr's most popular APIs and give you a starting point…☆24Dec 11, 2024Updated last year
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆135Nov 4, 2022Updated 3 years ago
- ☆17Apr 8, 2024Updated 2 years ago
- Repo for Introduction to Iceberg Video☆22Jun 3, 2024Updated 2 years ago
- Repository for IAE architectural documents.☆19May 15, 2018Updated 8 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Shell script that creates an AWS Lambda Layer with the specified (or latest) version of boto3☆11May 29, 2019Updated 7 years ago
- ☆41Jan 24, 2023Updated 3 years ago
- Apache Spark in 7 Days [Video], by Packt Publishing☆18Jan 30, 2023Updated 3 years ago
- A python implementation of PROCLUS: PROjected CLUStering algorithm.☆10Jan 12, 2015Updated 11 years ago
- Script scenarios and graph processing scripts for simulations used in "Rapid Traffic Information Dissemination Using Named Data" paper by…☆17Aug 23, 2013Updated 13 years ago
- Building a Modern Data Lake with Minio, Spark, Airflow via Docker.☆23May 11, 2024Updated 2 years ago
- A JupyterLab extension for reviewing GitHub pull requests☆38Feb 7, 2026Updated 8 months ago
- Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta…☆20May 6, 2023Updated 3 years ago
- 👻 A repository that provides sample export and import data into excel file using Django + Celery + Pandas with a Progress Bar ❤️☆18Oct 8, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Qonversion Capacitor plugin: iOS and Android purchases confirmed with the stores, entitlements, and the revenue data behind Apple Ads, A/…☆14Oct 14, 2026Updated 2 weeks ago
- Project to experiment with a microservices architecture based on Apache Kafka☆22Jul 8, 2023Updated 3 years ago
- Prova de conceito - Springboot, Java, Schema Registry, Apache Avro e Apache Kafka .☆14Apr 18, 2023Updated 3 years ago
- ☆37Jan 29, 2021Updated 5 years ago
- Generate DBT tests based on sample data☆37Feb 28, 2024Updated 2 years ago
- A simple spark standalone cluster for your testing environment purposses☆567Mar 6, 2024Updated 2 years ago
- Apache Spark 3 for Data Engineering and Analytics with Python , By Packt publishing☆24Jul 23, 2023Updated 3 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆25May 14, 2022Updated 4 years ago
- Implementation of trajectory outlier detection methods in C++/Qt5. This methods are TRAOD and iBoat☆13May 28, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Development environment and template project for creating simple Kafka Connect connectors☆14May 1, 2026Updated 6 months ago
- Library which aim to generate kubernetes yamls templates from an Airflow dag using the Airflow Kuberntes Pod Operator☆10May 6, 2021Updated 5 years ago
- Apache Spark enhanced with native Kubernetes scheduler back-end☆15Aug 21, 2023Updated 3 years ago
- Pytest plugin for mocking BigQuery data from the python BigQuery client.☆14Feb 6, 2023Updated 3 years ago
- Example of orchestrating dependent Databricks jobs using Airflow☆11Dec 19, 2019Updated 6 years ago
- ☆93Feb 4, 2025Updated last year
- Vault Plugin: Google Cloud Platform CA Service☆17Jul 20, 2021Updated 5 years ago