linkedin / data-integration-library
The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and egress.
☆28Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for data-integration-library
- Data abstraction, storage, discovery, and serving system☆31Updated 3 weeks ago
- Dione - a Spark and HDFS indexing library☆50Updated 7 months ago
- Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http:…☆71Updated last year
- Cloud Storage Connector integrates Apache Pulsar with cloud storage.☆28Updated this week
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 3 years ago
- LinkedIn's version of Apache Calcite☆22Updated this week
- pulsar lakehouse connector☆30Updated this week
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated last year
- Serializable ACID transactions on streaming data☆23Updated 2 years ago
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Updated 9 years ago
- Apache flink☆23Updated last week
- Mirror of Apache NiFi Flow Design System☆42Updated last year
- Connect DBVisualizer to Hortonwork HiveServer2☆9Updated 9 years ago
- Transporter for integrating OpenLineage with OpenMetadata☆12Updated 8 months ago
- Apache Pulsar Adapters☆24Updated 10 months ago
- Hadoop/Hive/Spark container to perform CI tests☆11Updated 3 years ago
- This library contains various Apache Flink connectors to connect to AWS data sources and sinks.☆14Updated 11 months ago
- Scala API for Apache Spark SQL high-order functions☆14Updated last year
- ☆30Updated 2 months ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 8 years ago
- CDAP UI☆19Updated last week
- calcite-arrow-sample(WIP)☆13Updated 6 years ago
- ☆17Updated last year
- Apiary provides modules which can be combined to create a federated cloud data lake☆36Updated 7 months ago