Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
☆135Nov 4, 2022Updated 3 years ago
Alternatives and similar repositories for docker-spark
Users that are interested in docker-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆513Nov 7, 2025Updated 8 months ago
- Docker image for Spark history server on Kubernetes☆15Mar 13, 2020Updated 6 years ago
- running apache spark with docker swarm☆34Feb 25, 2021Updated 5 years ago
- Apache Spark docker image☆2,050Apr 20, 2026Updated 3 months ago
- Kafka streaming with Spark and Flink example☆31Jul 16, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A ready to go Big Data cluster (Hadoop + Hadoop Streaming + Spark + PySpark) with Docker and Docker Swarm!☆22May 20, 2025Updated last year
- ☆11Jul 13, 2020Updated 6 years ago
- Tools and specifications for Semantic Data Dictionaries☆13May 21, 2026Updated 2 months ago
- ☆12Jan 8, 2023Updated 3 years ago
- R model API to support bucketing and masking☆12Oct 9, 2018Updated 7 years ago
- 使用容器搭建大数据架构微服务☆12Nov 28, 2017Updated 8 years ago
- Provider for AWS Redshift entities, eg Users, Groups, Permissions, Schemas, Databases☆47Mar 10, 2022Updated 4 years ago
- Data Extractor for the European e-Invoice Specification (EN16931)☆18Apr 4, 2025Updated last year
- the full pipeline for model retraining with fastapi and github actions☆16Jul 5, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Mirror of Apache livy (Incubating)☆13Feb 8, 2024Updated 2 years ago
- Deep Learning Projects with PyTorch [video], published by Packt☆12Jan 15, 2021Updated 5 years ago
- Autocomplete / Autofill Text field with Dropdown menu to choose between suggested values from a given list.☆14Feb 23, 2024Updated 2 years ago
- Source Code for 'Beginning Apache Spark 3' by Hien Luu☆13Oct 14, 2021Updated 4 years ago
- Generate cloud-init ready vm images via packer and deploy these via terraform.☆16Jan 6, 2026Updated 6 months ago
- Scripts and code written whilst learning and experimenting with machine learning☆12Jul 18, 2022Updated 4 years ago
- An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS ap…☆27Dec 7, 2022Updated 3 years ago
- Apache Spark 3 for Data Engineering and Analytics with Python , By Packt publishing☆24Jul 23, 2023Updated 3 years ago
- Docker with Airflow and Spark standalone cluster☆264Aug 5, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Distributed Data Systems with Azure Databricks, published by Packt☆12Jan 18, 2023Updated 3 years ago
- An implementation of Markov Clustering algorithm for Spark in Scala☆34Sep 10, 2017Updated 8 years ago
- Demo code showing how to use Java's StructuredTaskScope☆11Jun 9, 2026Updated last month
- chDB AWS Lambda container☆21Jul 21, 2026Updated last week
- CloudFormation template to create a VPC and subnets☆11Dec 2, 2021Updated 4 years ago
- PySpark data-pipeline testing and CICD☆28Oct 28, 2020Updated 5 years ago
- Collection of endpoints and environments used to access the iMIS RESTful interface☆14Jun 8, 2026Updated last month
- My MSc project☆14Jun 5, 2011Updated 15 years ago
- Redis Message Connector☆14Apr 7, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- DocNetwork's DevOps Application Challenge☆15Mar 22, 2025Updated last year
- Google FSI Accelerator Pattern☆13Jun 18, 2024Updated 2 years ago
- ☆11Dec 31, 2021Updated 4 years ago
- Apache Spark 3 - Spark Programming in Python for Beginners☆515Jul 25, 2024Updated 2 years ago
- ☆90Sep 24, 2022Updated 3 years ago
- Data and scripts for examining the Department of Defense's 1033 excess equipment program☆16Jun 21, 2022Updated 4 years ago
- This sample shows how to create two Azure Container Apps that use OpenAI, LangChain, ChromaDB, and Chainlit using Terraform.☆11May 7, 2024Updated 2 years ago