apache / sparkLinks
Apache Spark - A unified analytics engine for large-scale data processing
☆41,321Updated this week
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- Apache Hadoop☆15,126Updated this week
- Apache Flink☆24,954Updated this week
- Apache Hive☆5,725Updated this week
- Metadata Comparison Toolkit. As of now, V-1.0.0 only consists Comparison of two DDL file ( .sql ) or two DDL statement. You can also pars…☆10Updated last year
- Apache HBase☆5,348Updated last week
- The official home of the Presto distributed SQL query engine for big data☆16,378Updated this week
- Apache Storm☆6,633Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,498Updated last week
- Mirror of Apache Kafka☆30,279Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,088Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,005Updated last month
- Notes talking about the design and implementation of Apache Spark☆5,326Updated last year
- Apache Kylin☆3,717Updated 2 months ago
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆40,585Updated this week
- Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3☆14,389Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,159Updated this week
- Apache Iceberg☆7,584Updated this week
- Apache Cassandra®☆9,235Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,842Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,809Updated this week
- Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-l…☆2,552Updated 8 months ago
- A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.☆13,170Updated this week
- 酷玩 Spark: Spark 源代码解析、Spark 类库等☆3,489Updated 3 years ago
- Apache Druid: a high performance real-time analytics database.☆13,744Updated this week
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆15,579Updated this week
- Open source SQL Query Assistant service for Databases/Warehouses☆1,296Updated this week
- Apache Calcite☆4,864Updated this week
- Azkaban workflow manager.☆4,501Updated 11 months ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,873Updated last year
- Apache NiFi☆5,386Updated last week