dvryaboy / idl_storage_guidelinesLinks
This document attempts to capture useful patterns and warn about subtle gotchas when it comes to designing and evolving schemas for long-term serialized data. It is not intended as a guide for how to best represent a particular dataset or process.
☆13Updated 8 years ago
Alternatives and similar repositories for idl_storage_guidelines
Users that are interested in idl_storage_guidelines are comparing it to the libraries listed below
Sorting:
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 6 years ago
- Graph Analytics with Apache Kafka☆106Updated last week
- ☆21Updated 2 years ago
- Mirus is a cross data-center data replication tool for Apache Kafka☆207Updated last month
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆115Updated 5 years ago
- Generic tools and script to help operating Cassandra cluster☆56Updated 10 years ago
- Cascading on Apache Flink®☆54Updated 2 years ago
- Kafka End to End Encryption☆52Updated 2 years ago
- ## Auto-archived due to inactivity. ## Simple JVM Profiler Using StatsD and Other Metrics Backends☆15Updated 2 years ago
- CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)☆29Updated 8 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 2 months ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆73Updated 4 years ago
- A Kafka-Connect Sink for S3 with no Hadoop dependencies.☆57Updated 2 years ago
- ☆26Updated 6 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 9 months ago
- Stream Discovery and Stream Orchestration☆122Updated 3 weeks ago
- A Giter8 template for scio☆31Updated 2 months ago
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆96Updated 6 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 3 years ago
- Apiary provides modules which can be combined to create a federated cloud data lake☆37Updated last year
- No longer maintained. Use https://eventsizer.io instead.☆62Updated 6 years ago
- The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.☆154Updated 3 years ago
- A library for Spark DataFrame using MinIO Select API☆99Updated 6 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆134Updated 3 years ago
- Distributed System Testing as a Service☆52Updated 10 months ago
- A native Kafka protocol proxy for Apache Kafka☆21Updated 8 years ago
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 5 years ago
- Schema Registry integration for Apache Spark☆40Updated 3 years ago
- Environment, operations and runtime-meta testing tool.☆90Updated 4 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago