vngrs/spark-etl external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

vngrs/spark-etl

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/vngrs/spark-etl)

Close

vngrs / spark-etlView on GitHubMore

• External links
• Readme badge

Apache Spark based ETL Engine

☆71Oct 18, 2016Updated 9 years ago

Alternatives and similar repositories for spark-etl

Users that are interested in spark-etl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 9 years ago
• allwefantasy / ServiceframeworkDispatcher

  View on GitHub
  Serviceframework一个简单但灵活的模块引擎
  ☆31Jun 29, 2017Updated 9 years ago
• yamitzky / bottoku

  View on GitHub
  Bottoku, Micro Framework for Chat/Messenger Bots
  ☆10Sep 21, 2016Updated 9 years ago
• PacktPublishing / Fast-Data-Processing-with-Spark-2

  View on GitHub
  Fast-Data-Processing-with-Spark-2
  ☆22Jan 18, 2023Updated 3 years ago
• shenjitang / BeePasture

  View on GitHub
  蜜蜂牧场是一个数据采集清洗工具，也是一个ETL工具，同时也是一套脚本语言。
  ☆14Jul 1, 2018Updated 8 years ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• xiufengliu / BigETL

  View on GitHub
  This project is a unified ETL platform that support various data processing technologies, including Spark, Hive, Hadoop, Python, Linux Sh…
  ☆17Oct 16, 2015Updated 10 years ago
• dk-stationery / stationery-ink

  View on GitHub
  Distributed SQL base Realtime Streaming Computation Framework On Apache Storm, Spark
  ☆12Mar 14, 2016Updated 10 years ago
• konrads / spark-etl

  View on GitHub
  Set of ETL utils for Spark
  ☆15May 4, 2020Updated 6 years ago
• restbeast / restbeast

  View on GitHub
  Command line API client, an API testing tool and an easy load testing tool
  ☆19Feb 25, 2024Updated 2 years ago
• avensolutions / cdc-at-scale-using-spark

  View on GitHub
  Scalable CDC Pattern Implemented using PySpark
  ☆18Oct 8, 2025Updated 10 months ago
• xavient / Data-Ingestion-Platform

  View on GitHub
  ☆51Jul 24, 2026Updated 3 weeks ago
• tweetmagik / spark-yarn

  View on GitHub
  Launch Spark clusters on YARN
  ☆24Aug 29, 2011Updated 14 years ago
• wykingfly / ElasticSearch-SQL

  View on GitHub
  该项目主要是为了熟悉sql的人员能够很方便的进行elasticsearch数据的查询，降低学习成本。
  ☆47Jan 13, 2015Updated 11 years ago
• JohnSnowLabs / spark-nlp-streamlit

  View on GitHub
  Spark NLP for Streamlit
  ☆15Sep 12, 2021Updated 4 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• datasphere-oss / datasphere-service

  View on GitHub
  an open source dataworks platform
  ☆20Jun 4, 2021Updated 5 years ago
• IgorBerman / spark-gotchas

  View on GitHub
  Few things we've met during our etl project based on spark
  ☆24Mar 22, 2018Updated 8 years ago
• icgc-dcc / dcc-release

  View on GitHub
  Second generation of the ICGC DCC release ETL built on Spark
  ☆10Apr 8, 2019Updated 7 years ago
• rmetzger / flink-streaming-etl

  View on GitHub
  A demo repository for "streaming etl" with Apache Flink
  ☆44Jun 8, 2016Updated 10 years ago
• llvm-mirror / klee

  View on GitHub
  Mirror kept for legacy. Moved to https://github.com/llvm/llvm-project
  ☆17Dec 14, 2016Updated 9 years ago
• sqggles / sqlalchemy_dremio

  View on GitHub
  SQLAlchemy dialect for Dremio
  ☆16Feb 8, 2023Updated 3 years ago
• brett-chen / AMC

  View on GitHub
  Code for KDD 2014 paper "Mining Topics in Documents: Standing on the Shoulders of Big Data"
  ☆21Oct 6, 2015Updated 10 years ago
• OndraFiedler / spark-recommender

  View on GitHub
  Scalable recommendation system written in Scala using the Apache Spark framework
  ☆105Jan 30, 2015Updated 11 years ago
• datasphere-oss / datasphere-docs

  View on GitHub
  DataSphere 产品文档
  ☆12Sep 25, 2019Updated 6 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• qzchenwl / hiveql-parser

  View on GitHub
  HiveQL Parser. Parse HiveQL code and print AST in JSON format if success, else print well formed syntax error message.
  ☆25May 1, 2017Updated 9 years ago
• johanprinsloo / akka-micro-dag

  View on GitHub
  Quick Akka Micro Dag Prototype
  ☆13Apr 8, 2016Updated 10 years ago
• bernhard-42 / spark-yarn-rest-api

  View on GitHub
  Demonstrates how to submit a job to Spark on HDP directly via YARN's REST API from any workstation
  ☆23Apr 18, 2016Updated 10 years ago
• SETL-Framework / setl

  View on GitHub
  A simple Spark-powered ETL framework that just works 🍺
  ☆186Oct 2, 2025Updated 10 months ago
• RedisLabs / ReSearch

  View on GitHub
  Redis search and indexing in Java
  ☆16Sep 26, 2016Updated 9 years ago
• gangtao / echarts_for_splunk

  View on GitHub
  customer visualization for splunk using echarts
  ☆15May 11, 2017Updated 9 years ago
• bluecolor / octopus

  View on GitHub
  Open source task scheduler with dependency management
  ☆15Jul 1, 2018Updated 8 years ago
• dazheng / SparkETL

  View on GitHub
  Implement a complete data warehouse etl using spark SQL
  ☆14Sep 8, 2022Updated 3 years ago
• EncodePanda / spark-workshop

  View on GitHub
  ☆14May 23, 2017Updated 9 years ago
• End-to-end encrypted email - Proton Mail • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
• spoddutur / spark-streaming-monitoring-with-lightning

  View on GitHub
  Plot live-stats as graph from ApacheSpark application using Lightning-viz
  ☆18Jul 3, 2017Updated 9 years ago
• cloudera-labs / envelope

  View on GitHub
  Build configuration-driven ETL pipelines on Apache Spark
  ☆162Oct 4, 2022Updated 3 years ago
• pdaodao / fiflow

  View on GitHub
  flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0
  ☆113Jun 21, 2022Updated 4 years ago
• indix / sparkplug

  View on GitHub
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆28May 15, 2020Updated 6 years ago
• jerryygit / ZRDSL

  View on GitHub
  json或SQL语言转为flink或者spark流/批任务
  ☆12Jun 21, 2022Updated 4 years ago
• ycloudnet / ya100

  View on GitHub
  一个比Spark-Parquet还快5~100倍的存储格式
  ☆12Feb 22, 2016Updated 10 years ago
• bylee5 / calcite-elasticsearch

  View on GitHub
  ☆14Oct 5, 2022Updated 3 years ago