Alternatives and similar repositories for flink-at-scale

Users that are interested in flink-at-scale are comparing it to the libraries listed below

• polyzos / stream-processing-with-apache-flink
  ☆59Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆108Updated 3 months ago
• bitsondatadev / trino-getting-started
  ☆267Updated 11 months ago
• twalthr / flink-api-examples
  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
  ☆64Updated 2 years ago
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆317Updated last week
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆186Updated 8 months ago
• pmoskovi / flink-learning-resources
  A curated list of Apache Flink learning resources
  ☆94Updated 8 months ago
• knaufk / advent-of-flink-2024
  One bite-sized tip or trick for Apache Flink practitioners every day leading up to Christmas Eve 2024.
  ☆26Updated 9 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆414Updated 4 months ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆118Updated last week
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆99Updated 8 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆263Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆128Updated last month
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last month
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last week
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆286Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated 2 months ago
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆35Updated 7 months ago
• japila-books / spark-sql-internals
  The Internals of Spark SQL
  ☆475Updated last week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 5 months ago
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆588Updated last year
• trinodb / trino-gateway
  ☆228Updated this week
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆235Updated 3 months ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆28Updated last month
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆61Updated 2 years ago
• MaterializeInc / datagen
  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
  ☆166Updated 3 weeks ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆81Updated 5 months ago