palantir / spark
Palantir Distribution of Apache Spark
☆67Updated last year
Related projects ⓘ
Alternatives and complementary repositories for spark
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 3 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆62Updated 6 months ago
- UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy☆59Updated 10 months ago
- Spark Structured Streaming State Tools☆34Updated 4 years ago
- ACID Data Source for Apache Spark based on Hive ACID☆97Updated 3 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated 8 months ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆60Updated 2 months ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆56Updated last year
- Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.☆75Updated 6 months ago
- JUnit integration for testing the Apache Hive Metastore and HiveServer2 Thrift APIs☆25Updated last month
- type-class based data cleansing library for Apache Spark SQL☆79Updated 5 years ago
- WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging …☆30Updated 4 months ago
- Spark Connector to read and write with Pulsar☆112Updated this week
- Enabling Spark Optimization through Cross-stack Monitoring and Visualization☆47Updated 7 years ago
- Splittable Gzip codec for Hadoop☆69Updated last week
- Peel is a framework that helps you to define, execute, analyze, and share experiments for distributed systems and algorithms.☆27Updated 2 years ago
- Serializable ACID transactions on streaming data☆23Updated 2 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- LinkedIn's version of Apache Calcite☆22Updated this week
- Custom state store providers for Apache Spark☆93Updated 2 years ago
- A tool to get better debug info on spark's memory usage☆42Updated 5 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆187Updated last year
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 3 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆158Updated 2 years ago
- ☆39Updated 5 years ago
- A tool to validate data, built around Apache Spark.☆101Updated this week
- Thoughts on things I find interesting.☆17Updated 3 years ago
- Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.☆86Updated 8 months ago
- This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.☆75Updated last year
- Graph Analytics with Apache Kafka☆101Updated this week