Alternatives and similar repositories for kdbspark

Users that are interested in kdbspark are comparing it to the libraries listed below

• KxSystems / kafka
  kdb+ to Apache Kafka adapter, for pub/sub
  ☆54Updated last year
• microsoft / hyperspace
  An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
  ☆428Updated 3 years ago
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• julienledem / redelm
  an anagram
  ☆136Updated 4 years ago
• lightbend / flink-operator
  Helm Chart for lyft/flinkk8soperator
  ☆11Updated 5 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆93Updated 4 months ago
• minio / spark-select
  A library for Spark DataFrame using MinIO Select API
  ☆99Updated 6 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated 2 weeks ago
• dremio / gandiva
  Vectorized processing for Apache Arrow
  ☆485Updated 3 years ago
• palantir / spark
  Palantir Distribution of Apache Spark
  ☆70Updated 2 years ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 4 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• qubole / rubix
  Cache File System optimized for columnar formats and object stores
  ☆185Updated 3 years ago
• deephaven / barrage
  An arrow flight extension to support ticking datasets via IPC
  ☆26Updated last week
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆184Updated 2 years ago
• zrlio / albis
  Albis: High-Performance File Format for Big Data Systems
  ☆21Updated 7 years ago
• AbsaOSS / cobrix
  A COBOL parser and Mainframe/EBCDIC data source for Apache Spark
  ☆153Updated 2 weeks ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• Aiven-Open / s3-connector-for-apache-kafka
  Aiven's S3 Sink Connector for Apache Kafka®
  ☆71Updated last year
• hortonworks / registry
  Schema Registry
  ☆17Updated last year
• Netflix / iceberg
  Iceberg is a table format for large, slow-moving tabular data
  ☆482Updated 2 years ago
• tideworks / arvo2parquet
  Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
  ☆38Updated 3 years ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆63Updated this week
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated 2 months ago
• spirom / spark-data-sources
  Developing Spark External Data Sources using the V2 API
  ☆48Updated 7 years ago
• twosigma / flint
  A Time Series Library for Apache Spark
  ☆1,020Updated 5 years ago
• yahoo / maha
  A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.
  ☆131Updated 8 months ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 7 months ago
• fingltd / 4mc
  4mc - splittable lz4 and zstd in hadoop/spark/flink
  ☆110Updated 2 years ago