Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes master. Secure it with keycloak
☆23Feb 22, 2022Updated 4 years ago
Alternatives and similar repositories for airflow-by-example
Users that are interested in airflow-by-example are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FIWARE 305: Real-time Processing of Context Data using Apache Flink☆11May 15, 2026Updated 3 months ago
- ☆11Jan 7, 2023Updated 3 years ago
- Data pipeline that scrapes Rust cheater Steam profiles☆53Feb 13, 2022Updated 4 years ago
- NestJs module to easily implement event driven architecture using RxJs in any NestJs project☆10Apr 1, 2022Updated 4 years ago
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Project to concentrate files and settings for AWS EMR monitoring. Source: https://aws.amazon.com/blogs/big-data/monitor-and-optimize-anal…☆15Oct 11, 2024Updated last year
- ☆16Apr 25, 2019Updated 7 years ago
- 整理所有特征工程用到的方法，为了复用☆11Jan 11, 2021Updated 5 years ago
- Understanding the supply chain process data and implementing different algorithms, building a machine learning model that can predict whe…☆13Sep 7, 2022Updated 3 years ago
- a slackbot allowing you to search commandlinefu from within slack☆11Sep 8, 2016Updated 9 years ago
- A micro frontend solution based on single-spa and module federation☆16Aug 30, 2023Updated 3 years ago
- Gatsby theme for interactive remark code blocks powered by jupyter kernels for code execution.☆10Feb 12, 2020Updated 6 years ago
- 14天完成数据分析实战项目☆10Sep 7, 2022Updated 3 years ago
- This repository aims to onboard new users into Modeling in SAP Data Warehouse Cloud in the most practical manner. For that you will build…☆18Feb 2, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Capture HAR recordings from Chrome sessions or Selenium tests using Node.js☆12Jul 8, 2023Updated 3 years ago
- ☆11Jun 15, 2026Updated 2 months ago
- 🕵️♂️ pytest-xflaky is a flaky-test hunter pytest plugin that collects reports and automatically submits PRs to put flaky tests under qu…☆17Aug 24, 2026Updated last week
- Utility functions/scripts for working with GPUs.☆10Jul 5, 2021Updated 5 years ago
- Apache Airflow plugin that exposes custom secure API endpoints similar to the official Airflow API, providing richer capabilities to supp…☆11Feb 4, 2024Updated 2 years ago
- Demo Flink and Kafka project to show how to react on tracking events in real-time and trigger offer for customer engagement based on camp…☆14Nov 19, 2024Updated last year
- ☆12Aug 8, 2024Updated 2 years ago
- A demo of the elastic stack used for test monitoring☆10Jan 15, 2019Updated 7 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Because its never late to start taking notes and 'public' it...☆63Jun 3, 2025Updated last year
- ☆10Jun 10, 2025Updated last year
- ☆15Sep 13, 2022Updated 3 years ago
- A rough proof of concept for running the same WASM artifact on EC2, ECS/Fargate and Lambda☆18Nov 6, 2022Updated 3 years ago
- protobuf pyspark conversion☆23Jun 7, 2023Updated 3 years ago
- A simple project that trains an OpenNLP Named Entity Recognition model to identify ingredients in a recipe.☆14Oct 30, 2016Updated 9 years ago
- Generalized project for running Airflow DAGs, with possibility of skipping tasks already done for some set of input parameters.☆16Nov 16, 2022Updated 3 years ago
- Scalable in-database machine learning with PL/Python: Postgres Open SV 2017 talk☆13Feb 8, 2018Updated 8 years ago
- [WIP] ONNX parts yard. The various operations described in Operator Schemas are converted in advance into OP stand-alone ONNX files.☆11Mar 30, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- the solustion to https://openai.com/requests-for-research☆12Mar 23, 2017Updated 9 years ago
- Reinforcement Learning for Supply Chain Optimization☆15Feb 3, 2020Updated 6 years ago
- Scripts to automate Veracode security scans☆16Aug 13, 2013Updated 13 years ago
- FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...☆22Dec 29, 2025Updated 8 months ago
- An analysis, with a focus on demand forecasting, of transactional data associated with over 2.5 million customers and 31,868 SKUs over th…☆17Oct 4, 2020Updated 5 years ago
- ☆13Sep 25, 2024Updated last year
- A tool to automatically create and run your Python scripts in a virtual environment with installed dependencies☆19Jul 21, 2026Updated last month