hunters-ai / spark-adaptive-file-connectorLinks
Adaptive File Source Connector for Spark, optimised for reading from object stores
☆15Updated 2 years ago
Alternatives and similar repositories for spark-adaptive-file-connector
Users that are interested in spark-adaptive-file-connector are comparing it to the libraries listed below
Sorting:
- Maven plugin for generating Scala case classes and ADTs from Apache Avro schemas, datafiles, and protocols☆10Updated last year
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆112Updated 5 years ago
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 4 years ago
- low-level helpers for Apache Spark libraries and tests☆16Updated 6 years ago
- Big Data Toolkit for the JVM☆146Updated 4 years ago
- Data quality tools for Big Data☆19Updated 5 years ago
- ☆50Updated 4 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 9 years ago
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆28Updated 8 years ago
- A collection of Apache Parquet add-on modules☆30Updated last week
- Apache Amaterasu☆56Updated 5 years ago
- Coral is a real-time analytics and data science platform. It transforms streaming events and extract patterns from data via RESTful APIs.…☆147Updated 6 years ago
- An embedded job scheduler.☆115Updated last year
- Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.☆23Updated 7 years ago
- Spark cloud integration: tests, cloud committers and more☆19Updated 7 months ago
- functionstest☆33Updated 8 years ago
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆77Updated 6 years ago
- type-class based data cleansing library for Apache Spark SQL☆78Updated 6 years ago
- Library offering http based query on top of Kafka Streams Interactive Queries☆69Updated 2 years ago
- akka http gremlin 3 websocket connector☆31Updated 6 years ago
- ☆21Updated 2 years ago
- An SBT plugin for automatically calling Avro code generation and a thin scala wrapper for reading and writing Avro files☆22Updated 7 years ago
- something to help you spark☆64Updated 6 years ago
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆97Updated 5 years ago
- Deriving Spark DataFrame schemas from case classes☆44Updated last year
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Thin Scala wrapper for the Kafka Streams API☆49Updated 7 years ago
- Gradle plugin for generating scala case classes from apache avro schemas, datafiles and protocols☆12Updated 3 months ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Updated 10 months ago
- Sbt plugin for avro4s☆20Updated 7 years ago