linkedin / data-integration-library
The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and egress.
☆30Updated last week
Alternatives and similar repositories for data-integration-library:
Users that are interested in data-integration-library are comparing it to the libraries listed below
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- ☆39Updated 5 years ago
- Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…☆26Updated 3 years ago
- Amundsen Gremlin☆21Updated 2 years ago
- An Example Dremio ARP driven connector that supports SQLLite☆19Updated 10 months ago
- Data abstraction, storage, discovery, and serving system☆31Updated 3 months ago
- Apache flink☆22Updated 3 months ago
- Dione - a Spark and HDFS indexing library☆51Updated 10 months ago
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated 10 months ago
- Schema Registry integration for Apache Spark☆40Updated 2 years ago
- Wrangler Transform: A DMD system for transforming Big Data☆91Updated this week
- Demonstration of a Hive Input Format for Iceberg☆26Updated 3 years ago
- Scala API for Apache Spark SQL high-order functions☆14Updated last year
- Extensible streaming ingestion pipeline on top of Apache Spark☆44Updated 10 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆94Updated this week
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆118Updated this week
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Updated 9 years ago
- An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.☆41Updated 4 months ago
- LinkedIn's version of Apache Calcite☆22Updated 3 months ago
- Cask Hydrator Plugins Repository☆67Updated this week
- Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.☆32Updated 2 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- Apache Flagon is a suite of comprehensive, thin-client behavioral logging tools☆25Updated 3 months ago
- Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http:…☆71Updated 2 years ago
- A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…☆50Updated last year
- ☆14Updated last month
- ☆25Updated 5 months ago
- Client swagger for nifi with security☆38Updated 2 years ago
- Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines☆17Updated 5 years ago