flyteorg / datacatalogLinks
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
☆53Updated 2 years ago
Alternatives and similar repositories for datacatalog
Users that are interested in datacatalog are comparing it to the libraries listed below
Sorting:
- Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management …☆39Updated 2 years ago
- FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and…☆47Updated 2 years ago
- The Flyte data-sidecar that helps move the input and output data intelligently between containers☆10Updated 2 years ago
- A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage ab…☆60Updated 2 years ago
- Apache Pinot Golang Client managed by StarTree☆32Updated 4 months ago
- A distributed graph-based platform to automatically collect, discover, explore and relate multi-cluster Kubernetes resources and metadata…☆213Updated 2 years ago
- This repo provides a starting point for building applications using SingleStore, Redpanda (by Vectorized), and the Go language. SingleSto…☆23Updated last year
- An HFile-backed Key-Value Server☆43Updated 6 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 2 months ago
- Beneath is a serverless real-time data platform ⚡️☆84Updated 3 years ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- Altinity Dashboard helps you manage ClickHouse installations controlled by clickhouse-operator.☆68Updated last week
- A library for Spark DataFrame using MinIO Select API☆99Updated 6 years ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 4 years ago
- TalariaDB is a distributed, highly available, and low latency time-series database for Presto☆228Updated last year
- Connectors for capturing data from external data sources☆74Updated this week
- BigQuery Google Storage Based Data Loader☆57Updated 6 months ago
- Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl…☆28Updated 2 years ago
- Golang based remote data frames access (over gRPC or HTTP stream)☆28Updated last month
- Data Catalog for Databases and Data Warehouses☆35Updated last year
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 6 months ago
- A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar, etc.☆183Updated last week
- Kafka replicator is a tool used to mirror and backup Kafka topics across regions☆16Updated 2 years ago
- A tool for describing pure data pipelines that enables avoiding repeating work (incrementality) and keeping old data around (provenance)☆72Updated 5 years ago
- Airbyte is the go-sdk/cdk to help build connectors quickly in go. This package abstracts away much of the "protocol" away from the user a…☆41Updated last year
- Data ingestion library for Amundsen to build graph and search index☆204Updated last year
- Go Client for Hive Metastore☆14Updated 2 years ago
- Pravega Kubernetes Operator☆40Updated last year
- Use SQL to build ELT pipelines on a data lakehouse.☆288Updated 3 years ago
- Flyte Backend Plugins contributed by the Flyte community.☆29Updated 2 years ago