shirukai/spark-structured-datasource external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

shirukai/spark-structured-datasource

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/shirukai/spark-structured-datasource)

Close

shirukai / spark-structured-datasourceView on GitHubMore

• External links
• Readme badge

Custom datasource about spark structure streaming

☆12Jan 29, 2019Updated 7 years ago

Alternatives and similar repositories for spark-structured-datasource

Users that are interested in spark-structured-datasource are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• anicolaspp / SparkStreamSources

  View on GitHub
  Spark Custome Stream Source and Sink
  ☆12Jan 19, 2019Updated 7 years ago
• fdeantoni / spark-websocket-datasource

  View on GitHub
  A sample custom Spark Structured Streaming Datasource with Websockets
  ☆12May 14, 2020Updated 6 years ago
• tspannhw / nifi-convertjsontoddl-processor

  View on GitHub
  Apache NiFi 1.5/1.6/1.9.2+ Processor to produce DDL
  ☆11Nov 16, 2022Updated 3 years ago
• bluejoe2008 / spark-http-stream

  View on GitHub
  spark structured streaming via HTTP communication
  ☆18Jul 7, 2022Updated 4 years ago
• gitter-badger / waterdrop

  View on GitHub
  An easy-to-use, scalable spark streaming ETL tool and sdk
  ☆14Aug 14, 2017Updated 9 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• hortonworks-spark / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆23May 7, 2018Updated 8 years ago
• ilovethepc / CDH_offline_install

  View on GitHub
  CDH6.3.2离线安装
  ☆11Nov 2, 2020Updated 5 years ago
• aks-tel / mod_openai_asr

  View on GitHub
  Freeswitch Speech-To-Text module
  ☆17Aug 25, 2026Updated last week
• japila-books / spark-structured-streaming-internals

  View on GitHub
  The Internals of Spark Structured Streaming
  ☆420Mar 3, 2026Updated 6 months ago
• CyrusZhou-CN / openGauss_master_slave

  View on GitHub
  openGauss 数据库 docker compose ，patroni 自动主备切换，HAProxy 数据库读写负载均衡，测试环境
  ☆11May 16, 2022Updated 4 years ago
• wankunde / sql-runner

  View on GitHub
  ☆17Mar 19, 2024Updated 2 years ago
• junk16 / spark-yarn-cluster

  View on GitHub
  Apache Spark on Apache Yarn 2.6.0 cluster Docker image
  ☆11Oct 18, 2017Updated 8 years ago
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆29Apr 16, 2018Updated 8 years ago
• sderosiaux / parquet-custom-reader-writer

  View on GitHub
  Simple implementation of a custom parquet reader/writer
  ☆11Aug 12, 2016Updated 10 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• ilyaglow / dor

  View on GitHub
  🌦️ Domain Ranker
  ☆16Sep 7, 2019Updated 6 years ago
• wfxiang08 / rpc_proxy

  View on GitHub
  基于thrift的服务注册和发现框架
  ☆13Oct 9, 2017Updated 8 years ago
• sev7e0 / wow-spark

  View on GitHub
  spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例如master、shuffle源码分析，总结及翻译。
  ☆18Jul 19, 2023Updated 3 years ago
• brianm / jp

  View on GitHub
  Like jq, but with json pointers
  ☆16Nov 30, 2025Updated 9 months ago
• lidatui / mybatis-callable

  View on GitHub
  不破坏接口规范来查询存储过程
  ☆15May 20, 2014Updated 12 years ago
• philwinder / mesos-terraform

  View on GitHub
  Create an Amazon AWS Mesos cluster using Terraform
  ☆12Feb 15, 2017Updated 9 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing

  View on GitHub
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Jun 26, 2017Updated 9 years ago
• liekkassmile / flink-connector-clickhouse-1.13

  View on GitHub
  flink-connector-clickhouse-1.13
  ☆33Apr 15, 2026Updated 4 months ago
• holdenk / spark-structured-streaming-ml

  View on GitHub
  Structured Streaming Machine Learning example with Spark 2.0
  ☆95Apr 24, 2017Updated 9 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• xiaogp / recsys_structured_streaming

  View on GitHub
  kafka + structured streaming + phoenix + elasticsearch 基于行为日志实现热门推荐，用户偏好推荐，召回融合策略实现。
  ☆20Sep 5, 2023Updated 2 years ago
• zhang-xzhi / encodingchecker

  View on GitHub
  file encoding checker
  ☆17Feb 27, 2022Updated 4 years ago
• kzwang / elasticsearch-osem

  View on GitHub
  Object Search Engine Mapping for ElasticSearch
  ☆17Feb 13, 2014Updated 12 years ago
• bill-cc / metadata-hive-hook

  View on GitHub
  Hive hook, obtain task information from Hive, fetch input/output tables and lineage information from HSQL.
  ☆40Jul 23, 2023Updated 3 years ago
• MrQuJL / area-hot-product

  View on GitHub
  分析各区域热门商品 —— 使用 Flume 采集数据，MapReduce 或 Spark Core 进行数据清洗，最后使用 Hive 或 Spark SQL 进行数据的分析和处理。
  ☆17Feb 4, 2019Updated 7 years ago
• PacktPublishing / Implementing-Splunk-7-Third-Edition

  View on GitHub
  Implementing Splunk 7, Third Edition by Packt
  ☆13Jan 30, 2023Updated 3 years ago
• colorknight / moql-transx

  View on GitHub
  Translate moql syntax to syntax of X database
  ☆24Dec 3, 2025Updated 9 months ago
• s11e-dao / bsin-paas-all-in-one

  View on GitHub
  ☆25Oct 16, 2022Updated 3 years ago
• lookout / cassandra-statsd-agent

  View on GitHub
  Java Agent for Cassandra integration with StatsD
  ☆13Sep 24, 2015Updated 10 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• GatsbyNewton / hive-udf

  View on GitHub
  UDF, GenericUDF, UDTF, UDAF
  ☆11Jul 1, 2022Updated 4 years ago
• flaxsearch / lucene-solr-intervals

  View on GitHub
  Flax-maintained fork of Lucene/Solr with support for interval queries
  ☆15Oct 9, 2015Updated 10 years ago
• zmstone / snappyer

  View on GitHub
  A fast compressor/decompressor (wrapper for Erlang)
  ☆15Nov 16, 2025Updated 9 months ago
• hammerlab / spark-util

  View on GitHub
  low-level helpers for Apache Spark libraries and tests
  ☆16Dec 29, 2018Updated 7 years ago
• DTStack / catcher

  View on GitHub
  java性能采集工具
  ☆52Jul 24, 2018Updated 8 years ago
• leigu / brave-tracer-example

  View on GitHub
  ☆13Oct 28, 2015Updated 10 years ago
• avensolutions / cdc-at-scale-using-spark

  View on GitHub
  Scalable CDC Pattern Implemented using PySpark
  ☆18Oct 8, 2025Updated 10 months ago