shirukai/spark-structured-datasource external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

shirukai/spark-structured-datasource

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/shirukai/spark-structured-datasource)

Close

shirukai / spark-structured-datasourceView on GitHubMore

• External links
• Readme badge

Custom datasource about spark structure streaming

☆12Jan 29, 2019Updated 7 years ago

Alternatives and similar repositories for spark-structured-datasource

Users that are interested in spark-structured-datasource are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• anicolaspp / SparkStreamSources

  View on GitHub
  Spark Custome Stream Source and Sink
  ☆12Jan 19, 2019Updated 7 years ago
• tspannhw / nifi-convertjsontoddl-processor

  View on GitHub
  Apache NiFi 1.5/1.6/1.9.2+ Processor to produce DDL
  ☆11Nov 16, 2022Updated 3 years ago
• bluejoe2008 / spark-http-stream

  View on GitHub
  spark structured streaming via HTTP communication
  ☆18Jul 7, 2022Updated 3 years ago
• gitter-badger / waterdrop

  View on GitHub
  An easy-to-use, scalable spark streaming ETL tool and sdk
  ☆13Aug 14, 2017Updated 8 years ago
• ilovethepc / CDH_offline_install

  View on GitHub
  CDH6.3.2离线安装
  ☆11Nov 2, 2020Updated 5 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• xiaogp / recsys_structured_streaming

  View on GitHub
  kafka + structured streaming + phoenix + elasticsearch 基于行为日志实现热门推荐，用户偏好推荐，召回融合策略实现。
  ☆19Sep 5, 2023Updated 2 years ago
• TBDSUDC / tbds_maintance_dev_demo_project

  View on GitHub
  ☆15Apr 12, 2022Updated 4 years ago
• fizx / csvget

  View on GitHub
  Uses parselets and rwget to generate csv files from websites
  ☆47Oct 16, 2009Updated 16 years ago
• wankunde / sql-runner

  View on GitHub
  ☆17Mar 19, 2024Updated 2 years ago
• CyrusZhou-CN / openGauss_master_slave

  View on GitHub
  openGauss 数据库 docker compose ，patroni 自动主备切换，HAProxy 数据库读写负载均衡，测试环境
  ☆11May 16, 2022Updated 3 years ago
• japila-books / spark-structured-streaming-internals

  View on GitHub
  The Internals of Spark Structured Streaming
  ☆423Mar 3, 2026Updated last month
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆30Apr 16, 2018Updated 7 years ago
• spirom / spark-data-sources

  View on GitHub
  Developing Spark External Data Sources using the V2 API
  ☆49Apr 29, 2018Updated 7 years ago
• bfabry / specify-it

  View on GitHub
  Translation of the QuickCheck properties in the paper "How to specify it!" by John Hughes into clojure test.check
  ☆10Jul 19, 2019Updated 6 years ago
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• wx-chevalier / DataEngineering-Notes

  View on GitHub
  数据仓库实战：Hive、HBase、Kylin、ClickHouse
  ☆23Mar 15, 2026Updated 3 weeks ago
• foursquare / oozie-web

  View on GitHub
  A more pretty, more usable web dashboard for Apache Oozie, written in Scala.
  ☆72May 6, 2013Updated 12 years ago
• shrekwang / object-inspector

  View on GitHub
  用来检测java对象占用内存情况的小工具
  ☆16Mar 1, 2013Updated 13 years ago
• rasputnik / riemannq

  View on GitHub
  Simple riemann query tool written in Go.
  ☆21Dec 2, 2016Updated 9 years ago
• sderosiaux / parquet-custom-reader-writer

  View on GitHub
  Simple implementation of a custom parquet reader/writer
  ☆11Aug 12, 2016Updated 9 years ago
• alexdebrie / aws-api-performance-bakeoff

  View on GitHub
  Code and architecture diagrams for performance testing a few API approaches on AWS
  ☆10Apr 20, 2019Updated 6 years ago
• wfxiang08 / rpc_proxy

  View on GitHub
  基于thrift的服务注册和发现框架
  ☆13Oct 9, 2017Updated 8 years ago
• sev7e0 / wow-spark

  View on GitHub
  spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例如master、shuffle源码分析，总结及翻译。
  ☆18Jul 19, 2023Updated 2 years ago
• frankyu8 / ushas

  View on GitHub
  This project is used for tracking lineage when using spark. Our team is aimed at enhancing the ability of column relation during logical …
  ☆20Jan 7, 2022Updated 4 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• bill-cc / metadata-hive-hook

  View on GitHub
  Hive hook, obtain task information from Hive, fetch input/output tables and lineage information from HSQL.
  ☆40Jul 23, 2023Updated 2 years ago
• guenter / mesos-getting-started

  View on GitHub
  A tutorial that explains how to build a simple distributed fault-tolerant framework on top of Mesos
  ☆47Oct 4, 2022Updated 3 years ago
• mshtelma / spark-structured-streaming-jdbc-sink

  View on GitHub
  Spark Structured Streaming JDBC Sink
  ☆16Apr 26, 2021Updated 4 years ago
• brianm / jp

  View on GitHub
  Like jq, but with json pointers
  ☆16Nov 30, 2025Updated 4 months ago
• philwinder / mesos-terraform

  View on GitHub
  Create an Amazon AWS Mesos cluster using Terraform
  ☆12Feb 15, 2017Updated 9 years ago
• holdenk / spark-structured-streaming-ml

  View on GitHub
  Structured Streaming Machine Learning example with Spark 2.0
  ☆94Apr 24, 2017Updated 8 years ago
• lidatui / mybatis-callable

  View on GitHub
  不破坏接口规范来查询存储过程
  ☆15May 20, 2014Updated 11 years ago
• twosigma / riemann-jmx

  View on GitHub
  A reliable JMX connector for Riemann
  ☆25Mar 4, 2020Updated 6 years ago
• kzwang / elasticsearch-osem

  View on GitHub
  Object Search Engine Mapping for ElasticSearch
  ☆17Feb 13, 2014Updated 12 years ago
• Serverless GPU API endpoints on Runpod - Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• MrQuJL / area-hot-product

  View on GitHub
  分析各区域热门商品 —— 使用 Flume 采集数据，MapReduce 或 Spark Core 进行数据清洗，最后使用 Hive 或 Spark SQL 进行数据的分析和处理。
  ☆16Feb 4, 2019Updated 7 years ago
• traintracks / sparkstreaming-algebird-algorithms-demo

  View on GitHub
  ☆18Sep 7, 2014Updated 11 years ago
• PacktPublishing / Implementing-Splunk-7-Third-Edition

  View on GitHub
  Implementing Splunk 7, Third Edition by Packt
  ☆13Jan 30, 2023Updated 3 years ago
• wangxinpo777 / DataLinkX-P

  View on GitHub
  在原DatalinkX项目基础上进行了扩展，Flink+大模型（DeepSeek）智能数据中台;
  ☆38Sep 3, 2025Updated 7 months ago
• berndfo / zooterrain

  View on GitHub
  View Zookeeper znode tree in a browser
  ☆25Nov 18, 2015Updated 10 years ago
• larsgeorge / jmxtoolkit

  View on GitHub
  HBase tailored but otherwise generic JMXToolkit.
  ☆28Jul 6, 2016Updated 9 years ago
• GatsbyNewton / hive-udf

  View on GitHub
  UDF, GenericUDF, UDTF, UDAF
  ☆12Jul 1, 2022Updated 3 years ago