Alternatives and similar repositories for pyspark-s3-parquet-example

Users that are interested in pyspark-s3-parquet-example are comparing it to the libraries listed below

• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated 3 years ago
• BogdanCojocar / medium-articles
  Repo for all my code on the articles I post on medium
  ☆106Updated 3 years ago
• holdenk / spark-intro-ml-pipeline-workshop
  A simple introduction to using spark ml pipelines
  ☆26Updated 7 years ago
• BasPH / airflow-rocket
  Airflow code accompanying blog post.
  ☆21Updated 6 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆41Updated last year
• kaantas / spark-twitter-sentiment-analysis
  Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
  ☆55Updated 7 years ago
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 4 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 7 years ago
• paiml / awsbigdata
  AWS Big Data Certification
  ☆25Updated last year
• JasonSanchez / spark-streaming-twitter-kafka
  Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag
  ☆29Updated 9 years ago
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated last year
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 5 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆70Updated 6 years ago
• yodasco / pyspark-emr
  A toolset to streamline running spark python on EMR
  ☆20Updated 9 years ago
• florimondmanca / kafka-fraud-detector
  🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
  ☆89Updated 6 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆93Updated 7 years ago
• neo4j-contrib / training-v2
  ☆17Updated this week
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 5 years ago
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated 2 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 8 years ago
• aws-samples / cloud-experiments
  Open innovation with 60 minute cloud experiments on AWS
  ☆87Updated last year
• fastforwardlabs / cml_churn_demo_mlops
  ☆16Updated 2 years ago
• awslabs / sagemaker-graph-entity-resolution
  ☆17Updated last year
• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆14Updated 5 years ago
• tylerFowler / docker-superset
  An extendable Docker image for Airbnb's Superset platform, previously known as Caravel.
  ☆114Updated 3 years ago
• vincentclaes / datajob
  Build and deploy a serverless data pipeline on AWS with no effort.
  ☆111Updated 2 years ago
• rogaha / data-processing-pipeline
  Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
  ☆85Updated 8 years ago
• ShafiqaIqbal / AWS-Glue-Pyspark-ETL-Job
  A Pyspark job to handle upserts, conversion to parquet and create partitions on S3
  ☆28Updated 5 years ago
• aws-samples / serverless-ai-workshop
  This workshop demonstrates two methods of machine learning inference for global production using AWS Lambda and Amazon SageMaker
  ☆58Updated 5 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 8 years ago