hunters-ai / spark-adaptive-file-connectorLinks
Adaptive File Source Connector for Spark, optimised for reading from object stores
☆15Updated 2 years ago
Alternatives and similar repositories for spark-adaptive-file-connector
Users that are interested in spark-adaptive-file-connector are comparing it to the libraries listed below
Sorting:
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 4 years ago
- Maven plugin for generating Scala case classes and ADTs from Apache Avro schemas, datafiles, and protocols☆10Updated 2 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆112Updated 5 years ago
- Deriving Spark DataFrame schemas from case classes☆44Updated last year
- Big Data Toolkit for the JVM☆145Updated 4 years ago
- Writing application logic for Spark jobs that can be unit-tested without a SparkContext☆77Updated 6 years ago
- A quotation-based Scala DSL for scalable data analysis.☆63Updated 3 years ago
- low-level helpers for Apache Spark libraries and tests☆16Updated 6 years ago
- ☆45Updated 5 years ago
- A collection of Apache Parquet add-on modules☆30Updated last month
- Apache Amaterasu☆56Updated 5 years ago
- Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.☆15Updated 7 years ago
- Sbt plugin for avro4s☆20Updated 7 years ago
- akka http gremlin 3 websocket connector☆31Updated 6 years ago
- An embedded job scheduler.☆116Updated last year
- Diagram- and graph-generating library for Akka Streams☆95Updated 4 years ago
- A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.☆47Updated 9 years ago
- something to help you spark☆64Updated 6 years ago
- An easy way to deploy your Akka services to a distributed environment.☆30Updated 2 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29Updated 5 years ago
- An SBT plugin for automatically calling Avro code generation and a thin scala wrapper for reading and writing Avro files☆22Updated 7 years ago
- ☆50Updated 5 years ago
- Data quality tools for Big Data☆19Updated 5 years ago
- Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.☆23Updated 7 years ago
- Data-Driven Spark allows quick data exploration based on Apache Spark.☆29Updated 8 years ago
- ☆36Updated 3 years ago
- A dynamic data completeness and accuracy library at enterprise scale for Apache Spark☆29Updated 10 months ago
- Lightweight, functional and correct time-series library for scala. Easy manipulation, filtering and combination of time-series data.☆30Updated 3 years ago
- How to Create a Non-stop Microservices Platform using Akka☆51Updated 7 years ago
- Single node, in-memory DataFrame analytics library.☆42Updated 2 weeks ago