spirom/spark-data-sources external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

spirom/spark-data-sources

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/spirom/spark-data-sources)

Close

spirom / spark-data-sourcesView on GitHubMore

• External links
• Readme badge

Developing Spark External Data Sources using the V2 API

☆49Apr 29, 2018Updated 8 years ago

Alternatives and similar repositories for spark-data-sources

Users that are interested in spark-data-sources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• hughhyndman / kdbspark

  View on GitHub
  Spark Data Source (V2) for Kx Systems kdb+ Database
  ☆21May 28, 2020Updated 6 years ago
• assafmendelson / DataSourceV2

  View on GitHub
  ☆23Oct 8, 2018Updated 7 years ago
• ExpediaGroup / hiveberg

  View on GitHub
  Demonstration of a Hive Input Format for Iceberg
  ☆26Mar 12, 2021Updated 5 years ago
• aokolnychyi / spark-custom-datasource-example

  View on GitHub
  A sample implementation of the Spark Datasource API
  ☆23Apr 15, 2017Updated 9 years ago
• shirukai / spark-structured-datasource

  View on GitHub
  Custom datasource about spark structure streaming
  ☆12Jan 29, 2019Updated 7 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• spirom / learning-spark-with-java

  View on GitHub
  Self-contained examples using Apache Spark with the functional features of Java 8
  ☆64Apr 8, 2018Updated 8 years ago
• eto-ai / spark-video

  View on GitHub
  Processing videos on Apache Spark
  ☆13Feb 14, 2022Updated 4 years ago
• tmscarla / akka-big-data

  View on GitHub
  Implementation of a Big Data (batch and stream) distributed processing engine in Java using Akka actors.
  ☆12Feb 20, 2023Updated 3 years ago
• alanhamlett / eufy-security-dashboard

  View on GitHub
  Eufy Security iOS app for displaying camera and door sensors on a dashboard, with auto-refresh.
  ☆12Aug 11, 2022Updated 4 years ago
• linzhouzhi / mix-query

  View on GitHub
  基于 spark 混合查询平台，支持不同源数据库的联合查询，mysql hive presto ...
  ☆14Aug 3, 2017Updated 9 years ago
• Azure / azure-relay-node

  View on GitHub
  ☁️Node.js library for Azure Relay Hybrid Connections
  ☆12Jul 20, 2026Updated 3 weeks ago
• fishjoy / spark-alluxio-blockstore

  View on GitHub
  Use AlluxioBlockManager to intead TachyonBlockManager as spark's off_heap.
  ☆14Nov 3, 2016Updated 9 years ago
• zimmertr / Strava-Heatmap-String-Builder

  View on GitHub
  Generate Strava Heatmap URLs that are compatible with Caltopo's Custom Map Layers
  ☆16Apr 3, 2023Updated 3 years ago
• phatak-dev / spark-3.0-examples

  View on GitHub
  Examples of Spark 3.0
  ☆44Nov 11, 2020Updated 5 years ago
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• spirom / spark-streaming-with-kafka

  View on GitHub
  Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
  ☆196Apr 15, 2018Updated 8 years ago
• avensolutions / cdc-at-scale-using-spark

  View on GitHub
  Scalable CDC Pattern Implemented using PySpark
  ☆18Oct 8, 2025Updated 10 months ago
• huanhan / SmileMovie

  View on GitHub
  基于Kotlin+MVP+Rxjava2+okhttp3+Retrofit2+Dagger2的安卓电影爬虫app
  ☆11Nov 24, 2018Updated 7 years ago
• microsoft / masc

  View on GitHub
  Microsoft's contributions for Spark with Apache Accumulo
  ☆21Oct 13, 2020Updated 5 years ago
• BryanCutler / SparkArrowFlight

  View on GitHub
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆37Mar 9, 2021Updated 5 years ago
• tokoko / SparkFlightSql

  View on GitHub
  ☆10Jun 23, 2025Updated last year
• zrlio / parquet-generator

  View on GitHub
  Parquet file generator
  ☆22Apr 17, 2018Updated 8 years ago
• jerryshao / spark-kafka-0-8-sql

  View on GitHub
  Spark Structured Streaming Kafka 0.8 Source Implementation
  ☆35Apr 27, 2017Updated 9 years ago
• ansrivas / spark-structured-streaming

  View on GitHub
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Dec 5, 2019Updated 6 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• stanzhai / jvm-exercise

  View on GitHub
  JVM related exercises
  ☆11Jul 16, 2017Updated 9 years ago
• orientechnologies / spark-orientdb

  View on GitHub
  Apache Spark datasource for OrientDB
  ☆20Jun 12, 2021Updated 5 years ago
• phatak-dev / spark2.0-examples

  View on GitHub
  Examples of Spark 2.0
  ☆213Aug 11, 2021Updated 5 years ago
• banzaicloud / spark-metrics

  View on GitHub
  Spark metrics related custom classes and sinks (e.g. Prometheus)
  ☆186Aug 2, 2022Updated 4 years ago
• RHobart / spark-lineage-parent

  View on GitHub
  跟踪Spark-sql中的字段血缘关系
  ☆21Nov 11, 2024Updated last year
• moyano83 / High-Performance-Spark

  View on GitHub
  ☆31Oct 14, 2019Updated 6 years ago
• tweetmagik / spark-yarn

  View on GitHub
  Launch Spark clusters on YARN
  ☆24Aug 29, 2011Updated 14 years ago
• thesquelched / spark-lineage

  View on GitHub
  Spark SQL listener to record lineage information
  ☆28Jan 24, 2021Updated 5 years ago
• huangzworks / redis-cheatsheet

  View on GitHub
  《Redis 命令速查表》
  ☆14Nov 6, 2017Updated 8 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• awnuxkjy / DataMiningClassify

  View on GitHub
  naive bayesian，knn java demo
  ☆13Aug 29, 2013Updated 12 years ago
• cevoaustralia / glue-vscode

  View on GitHub
  Local Development of AWS Glue with Docker and Visual Studio Code
  ☆14Nov 29, 2021Updated 4 years ago
• lizhitao0923 / ansible-hadoop

  View on GitHub
  Ansible playbooks to help to deploy Apache Hadoop,Spark,Storm,Zookeeper,Elasticsearch,Azkaban,Flume,Hbase,Kafka,Kibana,Logstash
  ☆10Mar 21, 2017Updated 9 years ago
• hjacobs / connexion-example-redis-kubernetes

  View on GitHub
  Connexion Example REST Service with Redis Store
  ☆23Oct 21, 2019Updated 6 years ago
• fredrikhgrelland / data-mesh

  View on GitHub
  A cloud native data mesh implementation
  ☆12Jan 15, 2021Updated 5 years ago
• realxujiang / storm-kafka-examples

  View on GitHub
  storm kafka hdfs examples
  ☆21Nov 28, 2016Updated 9 years ago
• r7kamura / api-gateway-lambda-example

  View on GitHub
  An example application to integrate Amazon API Gateway and Amazon Lambda.
  ☆12Aug 5, 2015Updated 11 years ago