axiom-data-science / docker-luigi
π π³ Luigi in Docker - alpine and ubuntu images available
β51Updated 3 years ago
Alternatives and similar repositories for docker-luigi:
Users that are interested in docker-luigi are comparing it to the libraries listed below
- A project to help develop Luigi pipelines using Docker β³οΈβ79Updated 4 years ago
- Airflow plugin to transfer arbitrary files between operatorsβ78Updated 6 years ago
- A python client library for the Stitch Import APIβ42Updated last year
- A Pachyderm deep learning tutorial for conference workshopsβ19Updated 7 years ago
- Collection of some examples using zappa, to be used for documentation as helpful working samples / tutorials.β43Updated last year
- β54Updated 7 years ago
- Docker container to make running Luigi tasks real easy.β11Updated 8 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are instβ¦β36Updated 4 years ago
- Fork of aio-libs/aiokafkaβ27Updated last year
- fast and scalable Airflow on Kubernetes Setup.β28Updated last year
- REST-like API exposing Airflow data and operationsβ61Updated 6 years ago
- Send summary messages of your Luigi jobs to Slackβ46Updated 6 years ago
- Dockerfiles for dockerhub automated build.β7Updated 6 years ago
- A luigi powered analytics / warehouse stackβ88Updated 8 years ago
- Composable filesystem hooks and operators for Apache Airflow.β17Updated 3 years ago
- Opinionated Python ORM for DynamoDBβ27Updated 6 years ago
- A DockerSwarm Jupyterhub setup, which uses a NFS Server running in a Docker Container for persistent storageβ20Updated 7 years ago
- β54Updated 6 years ago
- β59Updated 5 years ago
- Example for an airflow pluginβ49Updated 8 years ago
- Slack notifications for the Luigi workflow managerβ46Updated 3 years ago
- Airflow workflow management platform chef cookbook.β71Updated 5 years ago
- A pandas.DataFrame-based ORM.β85Updated 3 years ago
- Base project for creating Python Apache Beam pipelines and running them in Google DataFlow using CRON schedulerβ23Updated 7 years ago
- Start a cluster in EC2 for dask.distributedβ106Updated 4 years ago
- Resize image on the fly using flask, zappa, pillow, opencv-pythonβ18Updated 7 years ago
- Cloud Pub/Sub Task Queue for Pythonβ210Updated 2 years ago
- Ansible role to deploy and configure Airflowβ41Updated 3 weeks ago
- Lightweight configuration and access to multiple databases in a single projectβ38Updated last year
- Repository with examples and smoke tests for the GCP Airflow operators and hooksβ147Updated 8 years ago