Alternatives and similar repositories for forklift

Users that are interested in forklift are comparing it to the libraries listed below

• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 8 months ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 6 months ago
• pranab / chombo
  Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm
  ☆103Updated last year
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 6 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Updated 5 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• ZuInnoTe / spark-hadoopoffice-ds
  A Spark datasource for the HadoopOffice library
  ☆38Updated 2 years ago
• yamrcraft / etl-light
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆41Updated 7 years ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• sourav-mazumder / Data-Science-Extensions
  ☆72Updated 4 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 3 years ago
• bmc / spark-hive-udf
  Example project showing how to use Hive UDFs in Apache Spark
  ☆55Updated 6 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• XavientInformationSystems / Data-Ingestion-Platform
  ☆49Updated 5 years ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆159Updated 2 years ago
• gtoonstra / databook
  A facebook for data
  ☆26Updated 5 years ago
• hbutani / spark-datetime
  functionstest
  ☆33Updated 8 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• dvasilen / Hive-XML-SerDe
  XML Serializer/Deserializer for Apache Hive
  ☆41Updated 5 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• tmalaska / Spark.TableStatsExample
  Simple Spark example of generating table stats for use of data quality checks
  ☆28Updated 8 years ago
• kawaa / Beetest
  A super simple utility for testing Apache Hive scripts locally for non-Java developers.
  ☆72Updated 8 years ago