Run Airflow on Kubernetes. This repository contains scripts to 1) run a multinode kubernets cluster on local machine using KinD, 2) prepare Dockerfile for your airflow dags 3) Minimal helm chart required to run airflow on kubernetes using Kubernetes Executor
☆17Apr 12, 2023Updated 2 years ago
Alternatives and similar repositories for airflow-on-kubernets
Users that are interested in airflow-on-kubernets are comparing it to the libraries listed below
Sorting:
- List customize [dot] files config.☆11May 14, 2025Updated 9 months ago
- ☆10Nov 25, 2021Updated 4 years ago
- This project uses a Long Short-Term Memory (LSTM) model, a type of recurrent neural network, to predict the future price of Bitcoin.☆14Jul 13, 2023Updated 2 years ago
- Data encoding library for Haskell.☆12Aug 4, 2023Updated 2 years ago
- 3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow☆12Aug 17, 2019Updated 6 years ago
- ☆39Jan 4, 2026Updated 2 months ago
- ☆10Aug 2, 2021Updated 4 years ago
- "C" APIs for HBase☆11Dec 17, 2014Updated 11 years ago
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Jul 7, 2021Updated 4 years ago
- Example static schema registry for Iglu☆15Jun 21, 2023Updated 2 years ago
- ☆15Jan 16, 2024Updated 2 years ago
- ☆13Feb 19, 2025Updated last year
- A curated list of awesome PrestoDB / Trino software, libraries, tools and resources☆18Jun 28, 2021Updated 4 years ago
- A 4 week program to get started with Data Science. Useful for beginners who want to get started by themselves.☆14Jun 15, 2016Updated 9 years ago
- Connects Campaign Manager to the RTB4FREE bidders☆13Nov 16, 2022Updated 3 years ago
- Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.☆20Jan 11, 2018Updated 8 years ago
- A project to develop a fully distributed MapReduce library for Haskell which makes using the MapReduce framework totally transparent for …☆20Nov 12, 2011Updated 14 years ago
- Apache Beam Python examples and templates.☆14Dec 8, 2022Updated 3 years ago
- Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…☆16May 11, 2019Updated 6 years ago
- Limit Order Book Convolutional Neural Network trading bot☆14Jul 24, 2022Updated 3 years ago
- Statistical and exploratory Analysis of Cricket Data☆12Oct 19, 2015Updated 10 years ago
- An ETL tool for converting untyped CSV to parquet. Also triggers data lake updates.☆15Oct 29, 2021Updated 4 years ago
- Sentiment Analysis and Trend Monitoring to Predict Cryptocurrency Market Movements☆15Nov 14, 2018Updated 7 years ago
- SchemaRegistry bindings with Avro scheme to use with kafka-client☆16Aug 6, 2025Updated 7 months ago
- ☆12Aug 11, 2021Updated 4 years ago
- dbt-github-workflow is a boilerplate that contains all the necessary configurations to set up a simple CI/CD pipeline for your data model…☆17Mar 27, 2022Updated 3 years ago
- Data Brewery is an ETL (Extract-Transform-Load) program that connect to many data sources (cloud services, databases, ...) and manage dat…☆16Jan 21, 2021Updated 5 years ago
- HTML5 Canvas Integration for Reflex Dom☆13Dec 19, 2019Updated 6 years ago
- Solutions to TopCoder problems, written in Python.☆16Mar 4, 2012Updated 14 years ago
- Automatically build a docker image with the ps3dev toolchain ready to be used for homebrew development.☆19Mar 11, 2024Updated last year
- Minikube for big data with Scala and Spark☆15Oct 28, 2019Updated 6 years ago
- SQS-based Python SDK for streaming data in realtime to the Panoply platform☆17Jun 22, 2025Updated 8 months ago
- OpenRTB v2.5 and OpenRTB Dynamic Native Ads v1.2 types for rust.☆21Feb 2, 2023Updated 3 years ago
- ☆16Feb 7, 2025Updated last year
- Demonstrations of DBT☆16Aug 5, 2019Updated 6 years ago
- Examples of all Machine Learning Algorithm in Apache Spark☆15Nov 2, 2017Updated 8 years ago
- Docker for airflow with mysql as backend☆12Nov 15, 2018Updated 7 years ago
- Source code for the "Scala For Beginners" book. https://leanpub.com/scalaforbeginners/☆14Oct 14, 2019Updated 6 years ago
- Collection of example and notes on Hadoop and Map Reduce☆17Jun 1, 2016Updated 9 years ago