palantir / sparkLinks
Palantir Distribution of Apache Spark
☆70Updated last year
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- Peel is a framework that helps you to define, execute, analyze, and share experiments for distributed systems and algorithms.☆27Updated 2 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 10 months ago
- Library for organizing batch processing pipelines in Apache Spark☆42Updated 8 years ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆61Updated last year
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Updated 4 years ago
- Code and presentation for Strata Model Serving tutorial☆68Updated 5 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 4 years ago
- Dione - a Spark and HDFS indexing library☆52Updated last year
- Spark Connector to read and write with Pulsar☆114Updated last week
- Serializable ACID transactions on streaming data☆25Updated 2 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- Spark Structured Streaming State Tools☆34Updated 5 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 5 years ago
- Scala Aggregators used for ML Model metrics monitoring☆91Updated last year
- Extensible streaming ingestion pipeline on top of Apache Spark☆45Updated last week
- A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.☆82Updated last year
- Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.☆38Updated 2 years ago
- A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.☆130Updated 5 months ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆61Updated 7 months ago
- Basic framework utilities to quickly start writing production ready Apache Spark applications☆36Updated 6 months ago
- Cascading on Apache Flink®☆54Updated last year
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆96Updated 5 years ago
- [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples☆70Updated 4 years ago
- ☆22Updated 6 years ago
- Splittable Gzip codec for Hadoop☆70Updated last week
- Apache Amaterasu☆56Updated 5 years ago
- Kafka Streams + Memcached (e.g. AWS ElasticCache) for low-latency in-memory lookups☆13Updated 5 years ago