chhantyal / luigi-kubernetes
Luigi with Kubernetes demo presented at Europython 2019 in Basel
☆27Updated 2 years ago
Alternatives and similar repositories for luigi-kubernetes:
Users that are interested in luigi-kubernetes are comparing it to the libraries listed below
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆99Updated 4 years ago
- A luigi powered analytics / warehouse stack☆87Updated 7 years ago
- ☆54Updated 6 years ago
- Interactive computing for complex data processing, modeling and analysis in Python 3☆77Updated 8 months ago
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 6 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆85Updated 8 years ago
- ☆197Updated last year
- Slides produced by Engineers and Data Scientists of Blue Yonder☆50Updated 5 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆85Updated 2 years ago
- A project to help develop Luigi pipelines using Docker ✳️☆78Updated 3 years ago
- Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…☆32Updated 5 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- ☆127Updated 4 years ago
- A web frontend for scheduling Jupyter notebook reports☆253Updated 2 months ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- Send summary messages of your Luigi jobs to Slack☆46Updated 5 years ago
- ☆16Updated 7 years ago
- Sample repo for luigi tasks & config☆36Updated 8 years ago
- A data science Python library aimed at adding fuzz, noise and other issues to your data for testing purposes.☆30Updated last year
- triggering a DAG run multiple times☆85Updated 11 months ago
- Quickly ingest messy CSV and XLS files. Export to clean pandas, SQL, parquet☆195Updated last year
- PyData London 2016 material☆37Updated 8 years ago
- An example mini data warehouse for python project stats, template for new projects☆178Updated 4 years ago
- dagster scikit-learn pipeline example.☆44Updated last year
- Code Repository for the EVO-ODAS☆31Updated 7 years ago
- T4 is now in production as Quilt 3☆64Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆70Updated 5 years ago
- Start a cluster in EC2 for dask.distributed☆106Updated 4 years ago