Alternatives and similar repositories for flytekit-java

Users that are interested in flytekit-java are comparing it to the libraries listed below

• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆113Updated 5 years ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated 2 months ago
• Striveworks / Flyte-Wingman
  Helps make it easier to utilize flyte from vs-code
  ☆11Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆62Updated last year
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated 5 months ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆116Updated 4 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated last year
• sjwiesman / flink-scala-3
  ☆36Updated 3 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 5 years ago
• embeddedkafka / embedded-kafka-schema-registry
  A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.
  ☆114Updated last week
• anemos-io / protobeam
  ☆22Updated 6 years ago
• tideworks / arvo2parquet
  Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
  ☆38Updated 3 years ago
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• JetBrains / ztools
  ☆18Updated 3 years ago
• saint1991 / serialization-benchmark
  benchmark for modern serialization systems: Apache Avro, Protocol Buffers, Apache Thrift and MessagePack written in Scala
  ☆27Updated 7 years ago
• farmdawgnation / kafka-hawk
  An application that records stats about consumer group offset commits and reports them as prometheus metrics
  ☆14Updated 6 years ago
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• AbsaOSS / spark-hofs
  Scala API for Apache Spark SQL high-order functions
  ☆14Updated 2 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 6 months ago
• scalapb / sparksql-scalapb
  SparkSQL utils for ScalaPB
  ☆43Updated 6 months ago
• spotify / scio.g8
  A Giter8 template for scio
  ☆31Updated 3 weeks ago
• QuickSign / kafka-encryption
  Kafka End to End Encryption
  ☆52Updated 2 years ago
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 2 months ago
• vitorsvieira / scala-graalvm-docker
  Docker images to build and generate native artifacts using GraalVM
  ☆59Updated 7 years ago
• garyaiki / dendrites
  Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.
  ☆23Updated 7 years ago
• RTBHOUSE / avro-fastserde
  Fast Apache Avro serialization/deserialization library
  ☆45Updated 5 years ago
• responsivedev / responsive-pub
  A highly available and infinitely scalable, drop-in replacement for Kafka Streams
  ☆19Updated 6 months ago