Alternatives and similar repositories for kdbspark

Users that are interested in kdbspark are comparing it to the libraries listed below

• KxSystems / kafka
  kdb+ to Apache Kafka adapter, for pub/sub
  ☆52Updated last year
• rymurr / flight-spark-source
  ☆105Updated last year
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 4 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• KxSystems / arrowkdb
  kdb+ integration with Apache Arrow and Parquet
  ☆31Updated last month
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆61Updated 6 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 3 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated 3 weeks ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 3 years ago
• adform / stream-loader
  Components for building stream loaders from Kafka to arbitrary storages
  ☆37Updated this week
• spirom / spark-data-sources
  Developing Spark External Data Sources using the V2 API
  ☆48Updated 7 years ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 2 years ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 3 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 5 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated this week
• deephaven / barrage
  An arrow flight extension to support ticking datasets via IPC
  ☆23Updated 6 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆224Updated 2 months ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• tideworks / arvo2parquet
  Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
  ☆38Updated 2 years ago
• aamargajbhiye / big-data-projects
  This project has customization likes custom data sources, plugins written for the distributed systems like Apache Spark, Apache Ignite et…
  ☆34Updated last year
• lightbend / flink-operator
  Helm Chart for lyft/flinkk8soperator
  ☆11Updated 5 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• microsoft / hyperspace
  An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
  ☆425Updated 3 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆98Updated 7 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last month