morsapaes / pyflink-nlp
Self-contained demo using PyFlink with Gensim+spaCy to find topics in the Flink User Mailing List. All you need is Docker! 🐳
☆20Updated 2 years ago
Related projects: ⓘ
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated last year
- spark on kubernetes☆105Updated last year
- ☆50Updated 9 months ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆81Updated 4 months ago
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆160Updated this week
- ☆232Updated this week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆64Updated 3 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆84Updated 3 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 3 years ago
- Repo for all my code on the articles I post on medium☆105Updated last year
- Airflow training for the crunch conf☆105Updated 5 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated 10 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- ☆197Updated last month
- ☆22Updated 3 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- PySpark data-pipeline testing and CICD☆28Updated 3 years ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆65Updated 2 years ago
- ☆38Updated this week
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆39Updated 3 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆171Updated 10 months ago
- Sample Airflow DAGs☆60Updated last year
- Apache Hive Metastore as a Standalone server in Docker☆64Updated 3 weeks ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆68Updated last week
- Multiple node presto cluster on docker container☆120Updated 2 years ago
- A Helm chart to install Apache Airflow on Kubernetes☆274Updated this week
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆207Updated this week
- Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.☆38Updated 2 years ago
- Atlas custom type definitions☆16Updated 3 years ago
- Automated data quality suggestions and analysis with Deequ on AWS Glue☆83Updated last year