chhantyal / luigi-kubernetes
Luigi with Kubernetes demo presented at Europython 2019 in Basel
☆26Updated 2 years ago
Alternatives and similar repositories for luigi-kubernetes:
Users that are interested in luigi-kubernetes are comparing it to the libraries listed below
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Introduction to Asyncio, presented at PyData Amsterdam 08/04/2017☆17Updated 8 years ago
- T4 is now in production as Quilt 3☆64Updated 5 years ago
- Interactive computing for complex data processing, modeling and analysis in Python 3☆77Updated 11 months ago
- A pandas.DataFrame-based ORM.☆85Updated 3 years ago
- Start a cluster in EC2 for dask.distributed☆106Updated 4 years ago
- Public repository for versioning machine learning data☆42Updated 3 years ago
- Shared-memory Python object namespace with Apache Plasma. Built because of Plotly Dash, useful anywhere.☆84Updated 3 months ago
- Summarise and explore Pandas DataFrames☆98Updated 4 years ago
- SQL on dataframes - pandas and dask☆64Updated 7 years ago
- Sample repo for luigi tasks & config☆36Updated 8 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- (Deprecated) Dash Extension for Google OAuth☆62Updated 4 years ago
- A data engineering pipeline for harvesting top author data from Medium☆16Updated 6 years ago
- Slides produced by Engineers and Data Scientists of Blue Yonder☆50Updated 5 years ago
- PyData London 2016 material☆37Updated 8 years ago
- Send summary messages of your Luigi jobs to Slack☆46Updated 6 years ago
- Apache Avro <-> pandas DataFrame☆137Updated 9 months ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- ☆37Updated 8 years ago
- Pytest magic for IPython notebooks☆37Updated last year
- Deploy dask on YARN clusters☆69Updated 8 months ago
- A validation library for Pandas data frames using user-friendly schemas☆191Updated 2 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- UNMAINTAINED☆29Updated 5 years ago
- A short guide for transitioning from Python to Scala☆65Updated 9 years ago
- ☆40Updated last year
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- An example mini data warehouse for python project stats, template for new projects☆178Updated 4 years ago
- Automated Exploratory Data Analysis. Simplifying Data Exploration☆34Updated 4 years ago