flyteorg / datacatalogLinks
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
☆53Updated 2 years ago
Alternatives and similar repositories for datacatalog
Users that are interested in datacatalog are comparing it to the libraries listed below
Sorting:
- Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management …☆39Updated 2 years ago
- FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and…☆47Updated 2 years ago
- An HFile-backed Key-Value Server☆43Updated 6 years ago
- A distributed graph-based platform to automatically collect, discover, explore and relate multi-cluster Kubernetes resources and metadata…☆213Updated 2 years ago
- The Flyte data-sidecar that helps move the input and output data intelligently between containers☆10Updated 2 years ago
- A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage ab…☆60Updated 2 years ago
- Airbyte is the go-sdk/cdk to help build connectors quickly in go. This package abstracts away much of the "protocol" away from the user a…☆40Updated last year
- Apache Pinot Golang Client managed by StarTree☆31Updated 3 months ago
- Beneath is a serverless real-time data platform ⚡️☆84Updated 3 years ago
- Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl…☆28Updated 2 years ago
- Golang based remote data frames access (over gRPC or HTTP stream)☆28Updated last month
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Go Client for Hive Metastore☆14Updated 2 years ago
- A Cloud Native Query Engine. Serverless, if it fits your case.☆54Updated 2 years ago
- A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar, etc.☆183Updated last week
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆60Updated 3 years ago
- This repo provides a starting point for building applications using SingleStore, Redpanda (by Vectorized), and the Go language. SingleSto…☆23Updated last year
- A library for Spark DataFrame using MinIO Select API☆99Updated 6 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 5 years ago
- Data Catalog for Databases and Data Warehouses☆35Updated last year
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆63Updated 2 weeks ago
- Explore Apache Kafka data pipelines in Kubernetes.☆46Updated 3 months ago
- Kafka replicator is a tool used to mirror and backup Kafka topics across regions☆16Updated 2 years ago
- States Language on Cadence☆63Updated 5 years ago
- Flyte Backend Plugins contributed by the Flyte community.☆29Updated 2 years ago
- Documentation and sample code for Altinity's Antalya branch of ClickHouse®☆62Updated last week
- Connectors for capturing data from external data sources☆73Updated this week
- A tool for describing pure data pipelines that enables avoiding repeating work (incrementality) and keeping old data around (provenance)☆72Updated 5 years ago
- Cloud Storage Connector integrates Apache Pulsar with cloud storage.☆29Updated 3 months ago
- Repository containing Cloud Storage Connectors for Apache Kafka®☆39Updated 2 weeks ago