Run Airflow on Kubernetes. This repository contains scripts to 1) run a multinode kubernets cluster on local machine using KinD, 2) prepare Dockerfile for your airflow dags 3) Minimal helm chart required to run airflow on kubernetes using Kubernetes Executor
☆17Apr 12, 2023Updated 3 years ago
Alternatives and similar repositories for airflow-on-kubernets
Users that are interested in airflow-on-kubernets are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆40Mar 13, 2026Updated 3 months ago
- open source data lake☆32Jan 17, 2025Updated last year
- ☆15Jan 16, 2024Updated 2 years ago
- Meu canal (Python) no YouTube☆11Apr 15, 2024Updated 2 years ago
- ☆13Feb 19, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Projeto Stack de dados OSS☆12Apr 8, 2025Updated last year
- List customize [dot] files config.☆11May 14, 2025Updated last year
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Jan 11, 2018Updated 8 years ago
- ☆10Aug 2, 2021Updated 4 years ago
- Mass Suricata rules creator, from a list of domain☆14Sep 14, 2018Updated 7 years ago
- Apache Beam Python examples and templates.☆14Dec 8, 2022Updated 3 years ago
- ☆10Nov 25, 2021Updated 4 years ago
- ☆12Jul 11, 2022Updated 3 years ago
- This project uses a Long Short-Term Memory (LSTM) model, a type of recurrent neural network, to predict the future price of Bitcoin.☆15Jul 13, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Guess what! ;)☆17Dec 16, 2025Updated 5 months ago
- An opinionated auto-deployer for the Hortonworks Platform☆34Feb 11, 2021Updated 5 years ago
- ☆68Sep 24, 2025Updated 8 months ago
- POC: Spark consumer for bottledwater-pg Kafka Avro topics☆16Aug 20, 2020Updated 5 years ago
- Data encoding library for Haskell.☆12Aug 4, 2023Updated 2 years ago
- ☆16Feb 7, 2025Updated last year
- CDN Selector allows you seemlessly switch between multiple CDNS☆24Mar 7, 2018Updated 8 years ago
- Example static schema registry for Iglu☆15Jun 21, 2023Updated 2 years ago
- Luna Rush Bot Auto Clicker☆31May 17, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Sep 23, 2019Updated 6 years ago
- ( These solutions tested on 4 node Hortonwork cluster on my laptop. Do not test on your production environment until you test... :)☆20Apr 18, 2020Updated 6 years ago
- A curated list of awesome PrestoDB / Trino software, libraries, tools and resources☆18Jun 28, 2021Updated 4 years ago
- Collection of example and notes on Hadoop and Map Reduce☆17Jun 1, 2016Updated 10 years ago
- An ETL tool for converting untyped CSV to parquet. Also triggers data lake updates.☆15Oct 29, 2021Updated 4 years ago
- Repo which holds the materials for the EMR Zero To Hero☆28May 7, 2022Updated 4 years ago
- Connects Campaign Manager to the RTB4FREE bidders☆14Nov 16, 2022Updated 3 years ago
- ☆42Oct 14, 2021Updated 4 years ago
- A simple Spark LDA example. to demonstrate a full fletched clustering algorithm, with data cleaning using the processess like lemmatizati…☆23Oct 8, 2016Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow☆13Aug 17, 2019Updated 6 years ago
- Spark GraphX - Pregel, PageRank and Dijkstra on a social graph☆23Jun 14, 2018Updated 8 years ago
- Code base for airflow training series Getting easy with Apache Airflow☆42Aug 13, 2023Updated 2 years ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Jul 7, 2021Updated 4 years ago
- Delta Lake Examples☆11Apr 24, 2020Updated 6 years ago
- ☆25Apr 6, 2019Updated 7 years ago
- SchemaRegistry bindings with Avro scheme to use with kafka-client☆16Aug 6, 2025Updated 10 months ago