Alternatives and similar repositories for bigdata_stack:

Users that are interested in bigdata_stack are comparing it to the libraries listed below

• minio / spark-select
  A library for Spark DataFrame using MinIO Select API
  ☆97Updated 5 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• Lewuathe / docker-trino-cluster
  Multiple node presto cluster on docker container
  ☆124Updated 2 years ago
• JahstreetOrg / spark-on-kubernetes-docker
  Spark on Kubernetes infrastructure Docker images repo
  ☆37Updated 2 years ago
• lensesio / kafka-connect-query-language
  SQL for Kafka Connectors
  ☆97Updated last year
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 2 months ago
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆84Updated 6 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 8 months ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆86Updated 10 months ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 4 months ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆114Updated this week
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• miho120 / ambari-airflow-mpack
  Ambari stack service for installing and managing Apache Airflow on HDP cluster
  ☆59Updated 6 years ago
• tashoyan / docker-spark-submit
  Docker image to submit Spark applications
  ☆38Updated 7 years ago
• sutugin / spark-streaming-jdbc-source
  ☆25Updated 3 years ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆97Updated last year
• getindata / kafka-connect-iceberg-sink
  ☆79Updated last year
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆66Updated 10 months ago
• tupol / spark-utils
  Basic framework utilities to quickly start writing production ready Apache Spark applications
  ☆35Updated last month
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 2 months ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• testdrivenio / spark-docker-swarm
  running apache spark with docker swarm
  ☆34Updated 3 years ago
• tikal-fuseday / delta-architecture
  Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
  ☆74Updated last year
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆63Updated 5 years ago
• mmolimar / ksql-jdbc-driver
  JDBC driver for Apache Kafka
  ☆87Updated 2 years ago