flyteorg / datacatalogLinks
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
☆54Updated last year
Alternatives and similar repositories for datacatalog
Users that are interested in datacatalog are comparing it to the libraries listed below
Sorting:
- Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management …☆39Updated last year
- FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and…☆47Updated last year
- A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage ab…☆60Updated last year
- The Flyte data-sidecar that helps move the input and output data intelligently between containers☆11Updated last year
- A distributed graph-based platform to automatically collect, discover, explore and relate multi-cluster Kubernetes resources and metadata…☆213Updated 2 years ago
- A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar, etc.☆182Updated last week
- Apache Pinot Golang Client managed by StarTree☆31Updated 3 weeks ago
- A Cloud Native Query Engine. Serverless, if it fits your case.☆54Updated 2 years ago
- Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl…☆28Updated last year
- An HFile-backed Key-Value Server☆42Updated 6 years ago
- Golang based remote data frames access (over gRPC or HTTP stream)☆28Updated 3 weeks ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆69Updated 5 months ago
- Flyte Backend Plugins contributed by the Flyte community.☆29Updated last year
- Kafka replicator is a tool used to mirror and backup Kafka topics across regions☆16Updated 2 years ago
- Beneath is a serverless real-time data platform ⚡️☆84Updated 3 years ago
- Airbyte is the go-sdk/cdk to help build connectors quickly in go. This package abstracts away much of the "protocol" away from the user a…☆39Updated last year
- Go Client for Hive Metastore☆14Updated 2 years ago
- This repo provides a starting point for building applications using SingleStore, Redpanda (by Vectorized), and the Go language. SingleSto…☆23Updated last year
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Data Catalog for Databases and Data Warehouses☆35Updated last year
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- Python framework for Cadence Workflow Service☆150Updated 3 years ago
- A library for Spark DataFrame using MinIO Select API☆98Updated 5 years ago
- Explore Apache Kafka data pipelines in Kubernetes.☆46Updated last month
- Ephemeral Hadoop clusters using Google Compute Platform☆136Updated 3 years ago
- Pulsar Beam is a streaming service via HTTP built on Apache Pulsar.☆60Updated 3 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 3 months ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 5 years ago
- Repository containing Cloud Storage Connectors for Apache Kafka®☆37Updated last month
- Log analysis pipeline utilizing Apache Beam☆25Updated 2 years ago