hunters-ai / spark-adaptive-file-connectorLinks
Adaptive File Source Connector for Spark, optimised for reading from object stores
☆15Updated 3 years ago
Alternatives and similar repositories for spark-adaptive-file-connector
Users that are interested in spark-adaptive-file-connector are comparing it to the libraries listed below
Sorting:
- Maven plugin for generating Scala case classes and ADTs from Apache Avro schemas, datafiles, and protocols☆10Updated 2 years ago
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆116Updated 4 years ago
- Big Data Toolkit for the JVM☆146Updated 5 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆115Updated 5 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Updated last year
- Apache Amaterasu☆56Updated 6 years ago
- Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.☆15Updated 7 years ago
- ☆50Updated 5 years ago
- Deriving Spark DataFrame schemas from case classes☆44Updated last year
- ☆45Updated 5 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 9 years ago
- something to help you spark☆64Updated 7 years ago
- An embedded job scheduler.☆116Updated last year
- low-level helpers for Apache Spark libraries and tests☆16Updated 7 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29Updated 5 years ago
- A collection of Apache Parquet add-on modules☆31Updated 2 weeks ago
- Thin Scala wrapper for the Kafka Streams API☆49Updated 7 years ago
- A quotation-based Scala DSL for scalable data analysis.☆64Updated 3 years ago
- Data quality tools for Big Data☆19Updated 6 years ago
- Spark cloud integration: tests, cloud committers and more☆20Updated last year
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆29Updated 9 years ago
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆76Updated 7 years ago
- Set of traits, objects and tools to make monitoring akka systems easy.☆33Updated 9 years ago
- SparkSQL utils for ScalaPB☆43Updated 7 months ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆62Updated last year
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- ☆36Updated 3 years ago
- Sbt plugin for avro4s☆20Updated 7 years ago
- front end to view akka cluster topography☆48Updated 8 years ago
- Scala client for MaxMind Geo-IP☆87Updated 2 months ago