The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and egress.
☆34Apr 30, 2026Updated 6 months ago
Alternatives and similar repositories for data-integration-library
Users that are interested in data-integration-library are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Feb 26, 2024Updated 2 years ago
- Full-stack OpenTelemetry observability for Apache Spark☆20Oct 12, 2026Updated 3 weeks ago
- A platform to manage the data product life cycle☆25Updated this week
- GraphFrames but in DataFusion☆60Oct 1, 2026Updated last month
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆11Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- scrapper for various science databases☆11Sep 14, 2023Updated 3 years ago
- An opinionated discussion around how to set up, structure, and deploy your AWS CDK Serverless apps using CDK Pipelines in line with AWS b…☆13Mar 4, 2023Updated 3 years ago
- This solution provides the AWS CDK and AWS CloudFormation infrastructure to build an enterprise data mesh with Amazon DataZone.☆10Jul 23, 2026Updated 3 months ago
- Curated list of awesome projen projects☆14Jan 1, 2025Updated last year
- Edit (code, prose) with things other than code☆12Aug 27, 2021Updated 5 years ago
- A declarative grammar that supports various technology stacks of AntV.☆13Apr 26, 2022Updated 4 years ago
- 🌳 Clingo grammar for tree-sitter☆16Oct 24, 2026Updated last week
- Support Case Insights with Amazon Q☆10Feb 24, 2026Updated 8 months ago
- This GitHub repository showcases the implementation of a comprehensive end-to-end MLOps pipeline using Amazon SageMaker pipelines to depl…☆10Jul 28, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Connect FastAPI to a Databricks Lakehouse☆10Jul 14, 2022Updated 4 years ago
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆29Jun 20, 2025Updated last year
- Website for the Agentic Risk & Capability Framework☆17Aug 30, 2026Updated 2 months ago
- Toolkit for Agile-driven data modeling and data loading using highly Normalized hybrid Model☆23Dec 24, 2024Updated last year
- [EACL 2026] The official GitHub repo for the paper "DebateQA: Evaluating Question Answering on Debatable Knowledge"☆11Jan 16, 2026Updated 9 months ago
- Visualization Recommendation Based on Analysis History☆15Aug 31, 2023Updated 3 years ago
- ☆15Updated this week
- Create AWS infrastructure for Matter☆15Updated this week
- This package contains the grammar in ANTLR g4 format and Java parser for the Data Quality Definition Language (DQDL), used by AWS Glue Da…☆24Oct 20, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- General Metadata Architecture☆143Sep 24, 2026Updated last month
- Airflow support for Marquez☆30Dec 11, 2020Updated 5 years ago
- library for processing s3select queries and execute them on CSV files (current phase)☆18Jan 5, 2026Updated 10 months ago
- Scala API for Apache Spark SQL high-order functions☆15Aug 4, 2023Updated 3 years ago
- OpenTracing instrumentation for the the Python's Elasticsearch clients☆11Jan 14, 2019Updated 7 years ago
- Husky for python☆13Jun 5, 2017Updated 9 years ago
- The public facing site of the OCF☆18Feb 15, 2024Updated 2 years ago
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 5 years ago
- University of Illinois letterhead template☆14Jun 4, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆16Jul 28, 2026Updated 3 months ago
- A test library to fill an object graph with random data☆11Oct 5, 2022Updated 4 years ago
- Pachyderm/MLeap team up to provide versioned datasets + models☆10Jun 7, 2017Updated 9 years ago
- This Guidance helps customers design a resilient batch process application using AWS services☆19Mar 1, 2026Updated 8 months ago
- React web app for Construct Hub☆21Updated this week
- Stock Managment Service for OpenLMIS v3.1+ http://openlmis.org☆21Updated this week
- Sample processing code using Spark 2.1+ and Scala☆51Jun 28, 2020Updated 6 years ago