Alternatives and similar repositories for flytekit-java

Users that are interested in flytekit-java are comparing it to the libraries listed below

• Striveworks / Flyte-Wingman
  Helps make it easier to utilize flyte from vs-code
  ☆11Updated 2 years ago
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆115Updated 5 years ago
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Updated 4 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆124Updated 2 weeks ago
• rymurr / flight-spark-source
  ☆108Updated 2 years ago
• tideworks / arvo2parquet
  Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
  ☆38Updated 3 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆62Updated last year
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆117Updated 4 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• 10xfuturetechnologies / kafka-connect-iceberg
  Kafka Connector for Iceberg tables
  ☆16Updated 2 years ago
• spotify / dbeam
  DBeam exports SQL tables into Avro files using JDBC and Apache Beam
  ☆193Updated 3 months ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆46Updated 6 months ago
• maropu / datasketches-spark
  Data Sketches for Apache Spark
  ☆22Updated 3 years ago
• spotify / scio.g8
  A Giter8 template for scio
  ☆31Updated this week
• nielsbasjes / splittablegzip
  Splittable Gzip codec for Hadoop
  ☆74Updated last month
• sjwiesman / flink-scala-3
  ☆36Updated 3 years ago
• flyteorg / flyteplugins
  Flyte Backend Plugins contributed by the Flyte community.
  ☆29Updated 2 years ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated this week
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 5 years ago
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆70Updated 5 months ago
• ExpediaGroup / hiveberg
  Demonstration of a Hive Input Format for Iceberg
  ☆26Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 3 years ago
• findify / featury
  Friendly ML feature store
  ☆45Updated 3 years ago
• JetBrains / ztools
  ☆18Updated 3 years ago
• rdblue / parquet-cli
  Parquet Command-line Tools
  ☆19Updated 9 years ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated 3 weeks ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆106Updated last year
• spotify / elitzur
  ☆23Updated last year
• AzimoLabs / kafka-to-avro-writer
  Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud s…
  ☆25Updated 4 years ago