axiom-data-science / docker-luigi
π π³ Luigi in Docker - alpine and ubuntu images available
β50Updated 3 years ago
Related projects β
Alternatives and complementary repositories for docker-luigi
- A project to help develop Luigi pipelines using Docker β³οΈβ78Updated 3 years ago
- Collection of some examples using zappa, to be used for documentation as helpful working samples / tutorials.β43Updated 9 months ago
- Airflow plugin to transfer arbitrary files between operatorsβ78Updated 6 years ago
- A luigi powered analytics / warehouse stackβ87Updated 7 years ago
- Send summary messages of your Luigi jobs to Slackβ46Updated 5 years ago
- Docker container to make running Luigi tasks real easy.β11Updated 8 years ago
- Example for an airflow pluginβ49Updated 8 years ago
- Resize image on the fly using flask, zappa, pillow, opencv-pythonβ18Updated 7 years ago
- A python client library for the Stitch Import APIβ42Updated 10 months ago
- Slack notifications for the Luigi workflow managerβ46Updated 3 years ago
- β54Updated 6 years ago
- Snowplow event tracker for Python. Add analytics to your Python and Django apps, webapps and gamesβ43Updated 2 months ago
- REST-like API exposing Airflow data and operationsβ61Updated 5 years ago
- A Pachyderm deep learning tutorial for conference workshopsβ19Updated 7 years ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are instβ¦β36Updated 4 years ago
- Zappa Docker image based on Lambda compatible baseβ83Updated 6 years ago
- Airflow workflow management platform chef cookbook.β68Updated 5 years ago
- β59Updated 4 years ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.β21Updated last year
- Start a cluster in EC2 for dask.distributedβ106Updated 4 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn insteadβ53Updated 6 years ago
- β54Updated 7 years ago
- kubernetes setup to bootstrap distributed on google container engineβ67Updated 5 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and maβ¦β41Updated 8 years ago
- python implementation of the parquet columnar file format.β21Updated last week
- Opinionated Python ORM for DynamoDBβ27Updated 5 years ago
- Comparison of Airflow on Celery vs Celeryβ21Updated 6 years ago
- Utils around luigi.β65Updated 3 years ago
- Collection of dask example notebooksβ57Updated 6 years ago
- A Singer.io Target for the Stitch Import APIβ26Updated last week