Alternatives and similar repositories for flink-at-scale

Users that are interested in flink-at-scale are comparing it to the libraries listed below

• polyzos / stream-processing-with-apache-flink
  ☆58Updated 11 months ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆90Updated last month
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆106Updated 10 months ago
• bitsondatadev / trino-getting-started
  ☆266Updated 9 months ago
• pmoskovi / flink-learning-resources
  A curated list of Apache Flink learning resources
  ☆83Updated 6 months ago
• twalthr / flink-api-examples
  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
  ☆64Updated last year
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last week
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆117Updated last week
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 6 months ago
• knaufk / advent-of-flink-2024
  One bite-sized tip or trick for Apache Flink practitioners every day leading up to Christmas Eve 2024.
  ☆26Updated 7 months ago
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆281Updated 2 weeks ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆126Updated last week
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 3 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆260Updated 10 months ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated this week
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆275Updated this week
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 5 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆410Updated 2 months ago
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆89Updated 6 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated last week
• apache / flink-statefun-playground
  Apache Flink Stateful Functions Playground
  ☆130Updated last year
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆26Updated last month
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆100Updated 2 years ago
• MaterializeInc / datagen
  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
  ☆163Updated 8 months ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆34Updated 5 months ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated this week
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆589Updated last year
• japila-books / kafka-internals
  The Internals of Apache Kafka
  ☆54Updated last year