Alternatives and similar repositories for s3-concat

Users that are interested in s3-concat are comparing it to the libraries listed below

• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 5 years ago
• industrydive / fileflow
  Airflow plugin to transfer arbitrary files between operators
  ☆78Updated 6 years ago
• laughingman7743 / PyAthenaJDBC
  PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).
  ☆95Updated last year
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• FreckleIOT / ecs-airflow
  Cloudformation templates for deploying Airflow in ECS
  ☆40Updated 6 years ago
• ychantit / airflow_aws_utils
  A collection of airflow sample workflows for data processing on aws
  ☆12Updated 7 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 6 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• hudl / luigi-monitor
  Send summary messages of your Luigi jobs to Slack
  ☆46Updated 6 years ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆75Updated 6 years ago
• onetapbeyond / lambda-spark-executor
  Apache Spark AWS Lambda Executor (SAMBA)
  ☆44Updated 6 years ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated 11 months ago
• pywebhdfs / pywebhdfs
  Pure Python wrapper for the Hadoop WebHDFS Rest API
  ☆52Updated 4 years ago
• hellonarrativ / spectrify
  Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.
  ☆117Updated 2 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆52Updated 2 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆72Updated 4 years ago
• snowplow-archive / spark-example-project
  A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR
  ☆118Updated 9 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• jwplayer / sparksteps
  CLI tool to launch Spark jobs on AWS EMR
  ☆67Updated last year
• josephadler / eventsim
  Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
  ☆28Updated 7 years ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 6 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆140Updated last month
• Scout24 / emr-autoscaling
  ☆16Updated 7 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• awsdocs / amazon-redshift-management-guide
  The open source version of the Amazon Redshift Cluster Management Guide.
  ☆48Updated last year
• miku / gluish
  Utils around luigi.
  ☆66Updated 4 years ago
• traviscrawford / spark-dynamodb
  DynamoDB data source for Apache Spark
  ☆95Updated 3 years ago
• hortonworks / hive-json
  A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.
  ☆42Updated last year