Alternatives and similar repositories for stream-collector

Users that are interested in stream-collector are comparing it to the libraries listed below

• snowplow / enrich
  Snowplow Enrichment jobs and library
  ☆24Updated 2 months ago
• scalapb / sparksql-scalapb
  SparkSQL utils for ScalaPB
  ☆43Updated 2 months ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 4 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 9 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆227Updated this week
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆34Updated 5 months ago
• snowplow / data-models
  ⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.
  ☆42Updated 7 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• GoogleCloudDataproc / flink-bigquery-connector
  BigQuery connector for Apache Flink
  ☆32Updated 3 weeks ago
• paypal / dione
  Dione - a Spark and HDFS indexing library
  ☆52Updated last year
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆235Updated 2 months ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆117Updated this week
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week
• tokoko / SparkFlightSql
  ☆10Updated last month
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated 2 weeks ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated last week
• snowplow / snowplow-rdb-loader
  Stores Snowplow enriched events in Redshift, Snowflake and Databricks
  ☆31Updated 4 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 3 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆106Updated 10 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• Radico / trino-plugins
  Simplified custom plugins for Trino
  ☆16Updated last year
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated 3 weeks ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆80Updated 3 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated 2 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆232Updated 6 months ago
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated 2 years ago
• spotify / gcs-tools
  GCS support for avro-tools, parquet-tools and protobuf
  ☆75Updated 3 months ago
• embeddedkafka / embedded-kafka-schema-registry
  A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.
  ☆115Updated this week