Alternatives and similar repositories for flink-at-scale

Users that are interested in flink-at-scale are comparing it to the libraries listed below

• polyzos / stream-processing-with-apache-flink
  ☆58Updated 11 months ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆89Updated 3 weeks ago
• pmoskovi / flink-learning-resources
  A curated list of Apache Flink learning resources
  ☆78Updated 6 months ago
• bitsondatadev / trino-getting-started
  ☆266Updated 8 months ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last month
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 9 months ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 6 months ago
• twalthr / flink-api-examples
  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
  ☆64Updated last year
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆117Updated last month
• knaufk / advent-of-flink-2024
  One bite-sized tip or trick for Apache Flink practitioners every day leading up to Christmas Eve 2024.
  ☆26Updated 6 months ago
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆90Updated 5 months ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated last month
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆273Updated last week
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated 2 weeks ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆271Updated this week
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 2 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 9 months ago
• MaterializeInc / datagen
  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
  ☆163Updated 7 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆227Updated this week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆79Updated 3 months ago
• streamthoughts / awesome-opensource-contribs-kafka
  A list of all awesome open-source contributions for the Apache Kafka project
  ☆104Updated 2 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆226Updated 9 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆408Updated 2 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• apache / flink-statefun-playground
  Apache Flink Stateful Functions Playground
  ☆130Updated last year
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated last week
• rockthejvm / spark-performance-tuning
  The official repository for the Rock the JVM Spark Optimization 2 course
  ☆40Updated last year
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆587Updated last year