Lets Airflow DAGs run Spark jobs via Livy: sessions and/or batches.
☆18May 23, 2023Updated 2 years ago
Alternatives and similar repositories for airflow-livy-operators
Users that are interested in airflow-livy-operators are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Text detection in natural scene images using the Stoke Width Transform.☆21Aug 6, 2012Updated 13 years ago
- The dbt-spark-livy adapter allows you to use dbt along with Apache Spark, by connecting via Apache Livy☆12Mar 30, 2023Updated 3 years ago
- Basic Spark utilities☆13Feb 20, 2025Updated last year
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Sep 20, 2019Updated 6 years ago
- Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.☆170Feb 4, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Presentation about Pyspark and how Arrow makes it faster☆22Oct 2, 2020Updated 5 years ago
- Official Jenkins image with Docker socket☆10Nov 13, 2019Updated 6 years ago
- Sample code with integration between Data Catalog and Hive data source.☆24Jan 29, 2025Updated last year
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆23Nov 3, 2015Updated 10 years ago
- Simple example showing how to use Kustomize to have different configuration for different environments☆16Aug 28, 2019Updated 6 years ago
- remoteStorage server implementation as a django app☆27Feb 11, 2020Updated 6 years ago
- ☆10Apr 13, 2020Updated 6 years ago
- ☆15May 16, 2024Updated last year
- My shell toolkit.☆12Sep 16, 2025Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆25Jan 4, 2023Updated 3 years ago
- A Getting Started Guide for developing and using Airflow Plugins☆93Nov 6, 2018Updated 7 years ago
- Python-based reports for Postgres including a data dictionary generator☆16Nov 13, 2015Updated 10 years ago
- Repository containing files from the 'Jenkins Configuration as Code - first encounter' blog post: https://automatingguy.com/2018/09/25/je…☆19Sep 26, 2018Updated 7 years ago
- Common Play Json implicits and helper methods☆15Aug 14, 2023Updated 2 years ago
- Practical Real-Time Data Processing and Analytics, published by Packt☆13Jan 14, 2021Updated 5 years ago
- Spark Standalone & Livy☆11Jul 13, 2021Updated 4 years ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆71Jan 5, 2022Updated 4 years ago
- Installing GitLab on Amazon ECS by Terraform☆25Jul 7, 2020Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Complete solution to enable RDMA (on both InfiniBand and RoCE) and accelerate TCP to bare metal performance on Kubernetes☆11Aug 1, 2018Updated 7 years ago
- A quiz/training app for Japanese learners. Written in Rust.☆15Apr 17, 2023Updated 3 years ago
- Dockerfiles to build service containers using SaltStack formulas☆24Jul 21, 2016Updated 9 years ago
- please visit new official repo: https://github.com/onepiecejs/nodejs-cantas☆111Dec 15, 2014Updated 11 years ago
- An Airflow plugin, providing an admin UI to conveniently start backfills. Usable with Airflow 1, 2 and Cloud Composer☆14Aug 16, 2022Updated 3 years ago
- ☆10Aug 2, 2016Updated 9 years ago
- LaTeX template for PKU Physics Review☆17Mar 24, 2018Updated 8 years ago
- 6th place solution in "Denoising Dirty Documents"☆60Jul 3, 2016Updated 9 years ago
- ☆23Feb 5, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ELK cluster provisioned by Terraform☆26Oct 25, 2018Updated 7 years ago
- Big Data Architect’s Handbook, published by Packt☆21Jan 30, 2023Updated 3 years ago
- Timestamps and Soft Delete Patterns in Django Models☆14Feb 14, 2026Updated 2 months ago
- ☆15Aug 16, 2023Updated 2 years ago
- manage your wechat with telegram bot☆24Jul 24, 2022Updated 3 years ago
- Apify actor-crawler providing an API for the transfermarkt.com website.☆11Feb 7, 2022Updated 4 years ago
- Security Manager for the Astronomer Airflow distribution☆11Jun 25, 2024Updated last year