flyteorg / datacatalogLinks
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
☆53Updated 2 years ago
Alternatives and similar repositories for datacatalog
Users that are interested in datacatalog are comparing it to the libraries listed below
Sorting:
- Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management …☆39Updated 2 years ago
- Apache Pinot Golang Client managed by StarTree☆33Updated this week
- A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage ab…☆60Updated 2 years ago
- An HFile-backed Key-Value Server☆43Updated 6 years ago
- FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and…☆47Updated 2 years ago
- This repo provides a starting point for building applications using SingleStore, Redpanda (by Vectorized), and the Go language. SingleSto…☆23Updated last year
- The Flyte data-sidecar that helps move the input and output data intelligently between containers☆10Updated 2 years ago
- A distributed graph-based platform to automatically collect, discover, explore and relate multi-cluster Kubernetes resources and metadata…☆213Updated 2 years ago
- A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar, etc.☆185Updated last week
- Go Client for Hive Metastore☆14Updated 3 years ago
- Airbyte is the go-sdk/cdk to help build connectors quickly in go. This package abstracts away much of the "protocol" away from the user a…☆41Updated last year
- Golang based remote data frames access (over gRPC or HTTP stream)☆28Updated last month
- Data Catalog for Databases and Data Warehouses☆36Updated 2 years ago
- Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl…☆28Updated 2 years ago
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆60Updated 3 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 5 months ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 9 months ago
- A Golang client for RedisAI☆25Updated last year
- TalariaDB is a distributed, highly available, and low latency time-series database for Presto☆229Updated last year
- tap-postgres☆68Updated last year
- Dremio Flight connector. Access Dremio using Arrow flight☆39Updated 5 years ago
- A tool for describing pure data pipelines that enables avoiding repeating work (incrementality) and keeping old data around (provenance)☆72Updated 5 years ago
- A Cloud Native Query Engine. Serverless, if it fits your case.☆54Updated 2 years ago
- Connectors for capturing data from external data sources☆78Updated this week
- Python framework for Cadence Workflow Service☆152Updated 3 years ago
- A library for Spark DataFrame using MinIO Select API☆99Updated 6 years ago
- Distributed SQL query engine written in Go for big data☆93Updated 7 years ago
- Pulsar Beam is a streaming service via HTTP built on Apache Pulsar.☆60Updated 3 years ago
- StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service☆363Updated 2 years ago
- Repository containing Cloud Storage Connectors for Apache Kafka®☆48Updated 2 weeks ago