reljicd / ml-airflowLinks
Generalized project for running Airflow DAGs, with possibility of skipping tasks already done for some set of input parameters.
β15Updated 2 years ago
Alternatives and similar repositories for ml-airflow
Users that are interested in ml-airflow are comparing it to the libraries listed below
Sorting:
- π¨ Simple, self-contained fraud detection system built with Apache Kafka and Pythonβ88Updated 6 years ago
- Build a recommendation engine with Spark and Watson Machine Learningβ46Updated 5 years ago
- A Scalable Data Cleaning Library for PySpark.β29Updated 6 years ago
- Example to implement machine learning microservice with gRPC and Docker in Pythonβ83Updated 3 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streamingβ55Updated 6 years ago
- Follow the Lumiata Tech Blog on Medium!β21Updated 2 years ago
- Udacity Data Pipeline Exercisesβ15Updated 5 years ago
- Repo for all my code on the articles I post on mediumβ107Updated 2 years ago
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etcβ51Updated 9 years ago
- Tutorial code and data for the entity resolution workshops.β45Updated 10 years ago
- Docker compose files for various kafka stacksβ32Updated 7 years ago
- Just a boilerplate for PySpark and Flaskβ35Updated 7 years ago
- PySpark phonetic and string matching algorithmsβ39Updated last year
- Large-scale Graph Mining with Sparkβ39Updated 6 years ago
- How to do data science with Optimus, Spark and Python.β19Updated 6 years ago
- β17Updated 6 years ago
- Example custom model image trainable and distributable via AWS SageMakerβ35Updated 2 years ago
- TensorFlow implementations of several deep learning models (e.g. variational autoencoder, RNN, ...)β37Updated 7 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.β47Updated last year
- Config files for setting up Multitenant Kubeflow on AWS with spot instancesβ10Updated 4 years ago
- Interesting datasets to use with Neo4jβ74Updated 4 years ago
- Build and run Spark Structured Streaming pipelines in Hadoop - project using PySpark.β13Updated 6 years ago
- Python Machine Learning (ML) project that demonstrates the archetypal ML workflow within a Jupyter notebook, with automated model deploymβ¦β62Updated 2 years ago
- Companion Notebooks and Data for Data Science with Python and Dask from Manning Publicationsβ52Updated 5 years ago
- REST API (and possible UI) for Machine Learning workflowsβ61Updated 6 years ago
- Simple alert system implemented in Kafka and Pythonβ97Updated 7 years ago
- ππ¨ Airflow tutorial for PyCon 2019β85Updated 2 years ago
- Model management example using Polyaxon, Argo and Seldonβ23Updated 6 years ago
- Used Spark core python, Spark sql, Spark MLlib, Spark Streamingβ47Updated 3 years ago
- Best practices for engineering ML pipelines.β35Updated 3 years ago